-- Logs begin at Wed 2022-08-03 11:29:41 UTC, end at Wed 2022-08-03 12:32:11 UTC. -- Aug 03 11:56:01.343463 dv-cinder-836027-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 03 11:56:01.351126 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 11:56:01 2022] *** Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: nodename: dv-cinder-836027-3-iscsi Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: machine: x86_64 Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: clock source: unix Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: pcre jit disabled Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: detected number of CPU cores: 4 Aug 03 11:56:01.353448 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: current working directory: / Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: detected binary path: /usr/bin/uwsgi-core Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: your processes number limit is 47680 Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: your memory page size is 4096 bytes Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: detected max file descriptor number: 2048 Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: lock engine: pthread robust mutexes Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: thunder lock: enabled Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 03 11:56:01.354323 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 11:56:01.394547 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: Python main interpreter initialized at 0x55f5869cf9c0 Aug 03 11:56:01.394547 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: python threads support enabled Aug 03 11:56:01.394547 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: your server socket listen backlog is limited to 100 connections Aug 03 11:56:01.394547 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: your mercy for graceful operations on workers is 90 seconds Aug 03 11:56:01.395044 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 11:56:01.395044 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: *** Operational MODE: preforking *** Aug 03 11:56:01.395308 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: *** uWSGI is running in multiple interpreter mode *** Aug 03 11:56:01.395308 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: spawned uWSGI master process (pid: 80339) Aug 03 11:56:01.395583 dv-cinder-836027-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 03 11:56:01.397961 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: spawned uWSGI worker 1 (pid: 80347, cores: 1) Aug 03 11:56:01.397961 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: spawned uWSGI worker 2 (pid: 80348, cores: 1) Aug 03 11:56:01.397961 dv-cinder-836027-3-iscsi devstack@keystone.service[80339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 11:56:07.004038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 11:56:07.004038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Aug 03 11:56:07.004848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 11:56:07.004848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Aug 03 11:56:07.055594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 11:56:07.055784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 11:56:07.055984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] command line args: [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 11:56:07.056262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 11:56:07.056445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ================================================================================ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 11:56:07.056706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.056959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_dir = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.057342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_source = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.057529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] debug = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.057744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.058981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.058981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.058981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.058981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.059225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.059282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_config_append = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.059464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.059622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_dir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.059803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.060056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.060298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.060554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.060808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.061170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.061433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.061676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.061916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.062155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.062403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.062653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.062908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.063157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.063443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.063951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.064139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] publish_errors = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.064379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.064617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.064801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.065056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.065296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.065537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] standard_threads = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.065780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_journal = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_json = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_stderr = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.066956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_syslog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.067194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.067458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.067702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.067973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.068222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.068481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.068725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.068983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.069226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.069484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.069738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.069996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.070235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.070511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.070754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.071009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.071262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.071504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.071766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.072026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.072277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.072522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.072784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.073055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.073317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.073575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.073813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.074050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.074287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.074688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.075494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.075752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.075991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.076237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.076493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.076749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.076994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.077250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.077491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.077736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.077979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.078219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.078495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.078715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.078954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.079199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.079456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.079695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.079941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.080177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.080420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.080661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.080919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.081042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 11:56:07.081042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: from cryptography.utils import int_from_bytes Aug 03 11:56:07.081620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.081620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.081840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 11:56:07.081840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: from cryptography.utils import int_from_bytes Aug 03 11:56:07.082044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.082044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.082273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.082385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.082538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.082793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.083036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.083281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.083519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.083789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.084033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.084270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.084514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.084755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.085031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.085277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.085533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.085784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.086025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.086273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.086644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.086781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.087024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.087265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.087512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.087754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.087994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.088234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.088504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.088713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.088984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.089231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.089478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.089722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.089968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.090209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.090515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.091275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.091514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.091751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.091986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.092227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.092461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.092707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.092949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.093206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.093450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.093714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.093985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.094234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.094491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.external = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.094734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.095041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.095281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.095520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.password = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.095757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.token = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.096002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.096249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.096503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.096820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.096997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.097249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.097486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.097741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.097998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.098256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.098536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.098783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.099034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.099275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.099548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.099811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.100056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.100318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.100613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.100870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.101140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.101389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.101653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.101895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.102141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.102415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.102702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.102957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.103212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.103459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.103719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.103960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.104297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.104464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.104729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.104973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.105230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.105485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.105728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.105971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.106261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.106530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.106972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.107091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.107292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.107530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.107766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.108018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.108249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.108505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.108760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.109020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.109273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.109551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.109794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.110036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.110643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.110643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.110896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.111011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.111230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.111476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.111782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.111968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.112222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.112612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.112730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.113018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.113299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.113430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.113700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.113886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.114128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.114513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.114688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.114901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.115233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.115494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.115755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.115992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.116235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.116491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.116746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.116991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.117235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.117475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.117713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.117958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.118229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.118482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.118738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.118993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.119245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.119487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.119722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.119964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.120204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.120447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.120684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.120937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.121190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.121443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.121723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.121979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.122215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.122506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.122732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.122970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.123210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.123451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.123701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.123957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.124200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.124461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.124698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.124949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.125191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.125433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.125677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.125936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.126191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.126429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.126695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.126944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.127203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.127461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.127703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.127959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.128215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.128457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.128710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.128951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.129201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.129438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.129688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.129920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.130176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.130433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.130710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.130963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.131218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.131620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.131876 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.132133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.132373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.132625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.132880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.133136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.133397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.133849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.134094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.134354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.134634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.134887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.135140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.135387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.135644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.135904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.136144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.136651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.136890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.137128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.137911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.138179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.138435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.138698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.138943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.139182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.139424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.139668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.139925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.140170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.140422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 11:56:07.140556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.140674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 11:56:07.140790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.140917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] command line args: [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 11:56:07.141039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.141161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 11:56:07.141276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.141390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ================================================================================ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 11:56:07.141510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.141634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] admin_token = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.141749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.141870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] config_dir = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.141984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.142098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.142098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] config_source = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.142328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.142478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] debug = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.142596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.142754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.142945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.143077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.143202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.143324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.143573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.143702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.143955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.144091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.144091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.144316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.144444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_config_append = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.144571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.144758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.144758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_dir = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.145015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.145135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.145252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.145370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.145533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.145658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.145785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.145906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.146037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.146157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.146336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.146604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.146604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.146842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.146962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.147080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.147198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.147519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.147646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.147765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.147928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.148170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.148314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.148444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.148695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.148825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.148955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.149076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.149201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.149330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.149450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.149569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.149569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.149914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.150659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] publish_errors = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] standard_threads = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.150906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] use_journal = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] use_json = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] use_stderr = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] use_syslog = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.152059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.153623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.153623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.153623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.153623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.153623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.154150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.154150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.154378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.154547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.154789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.155039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.155287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.155526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.155781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.156035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.156281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.156519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.156774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.157039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.157295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.157547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.157779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.158012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.158244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.158511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.158754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.159004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.159238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.159472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.159720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.159968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.160207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.160457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.160690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.160929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.161166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.161398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.161632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.161871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.162102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.162339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.162613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.162848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.163096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.163317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.163553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.163790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.164039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.164273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.164510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.164748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.164985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.165221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.165460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.165692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.165939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.166176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.166414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.166677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.166933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.167170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.167406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.167641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.167879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.168152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.168395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.168674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.168923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.169161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.169391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.169625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.169874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.170119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.170347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.170613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.170849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.171090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.171321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.171558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.171794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.172055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.172293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.172533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.172777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.173022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.173256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.173485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.173724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.173957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.174182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.174413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.174673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.174904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.175151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.175385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.175626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.175862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.176119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.176380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.176633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.176857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.external = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.177088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.177393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.177625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.177850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.password = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.177931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.178085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.token = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.178208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.178364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.178586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.178722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.178854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.179035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.179265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.179512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.179748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.179985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.180234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.180477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.180724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.180961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.181202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.181437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.181713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.181973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.182211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.182486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.182775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.183024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.183287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.183541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.183798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.184038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.184812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.185062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.185312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.185545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.185793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.186034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.186288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.186597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.186810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.187047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.187305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.187542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.187791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.188039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.188276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.188513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.188761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.188929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.189056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.189219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.189469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.189721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.189956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.190188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.190420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.190688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.190939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.191188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.191445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.191691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.191963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.192200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.192442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.192674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.192911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.193142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.193377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.193619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.193860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.194106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.194338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.194679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.194927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.195165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.195412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.195660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.195892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.196129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.196360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.196597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.196833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.197076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.197315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.197552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.197802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.198050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.198282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.198536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.198788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.199034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.199270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.199506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.199741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.200540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.200778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.201038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.201269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.201518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.201770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.202015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.202242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.202499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.202738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.202973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.203209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.203437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.203682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.203927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.204173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.204419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.204665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.204896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.205142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.205379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.205614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.205850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.206083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.206326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.206654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.206829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.207079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.207310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.207555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.207792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.208029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.208266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.208667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.208912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.209146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.209387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.209633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.209887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.210135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.210370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.210645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.210897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.211134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.211384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.211626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.211863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.212097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] role.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.212349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] role.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.212582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.212831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.213084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.213334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.213580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.213820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.214065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.214316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.214579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.214818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.215056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.215292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.215566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.215820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.216262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.216497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.216749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.216998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.217244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.217499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.217733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.217981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.218243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.218474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.218647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.218770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.218891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.219009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.219165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.219419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.219673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.219922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.220160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.220396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.220630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.220870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.221110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.221352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.221597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.221844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.222092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.222338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.222605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.222850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.223097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.223335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.223572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.223809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.224055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.224308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.224540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.224785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.225086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.225342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.225589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.225842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.226076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.226318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.226579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.226822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.227058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.227293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.227537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.227774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.228010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.228253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.228493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.228728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.228976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.229208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.229445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.229681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 11:56:07.229886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 11:56:07.255227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.255473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.255585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.264938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.272892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.284848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.285071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.322843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.325516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.325754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.360124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.360352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.393016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.393424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.393782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.394215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.394603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.394984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.403657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.403883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.404119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.404338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.404550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.404764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.420844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.421079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.421319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.421541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.421762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.421989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.422204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.422737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.422976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.423203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.423430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.423645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.423859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.424082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.433798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.435164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.447473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.447669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.447756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.447831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.447939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.448881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 11:56:07.466554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.466778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 11:56:07.467086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.467284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.467428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 11:56:07.467550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 11:56:07.467642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.467772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.467849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.468025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 11:56:07.468139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.468272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.468396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.468553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.468811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.469075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.478070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.478361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.478658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.478940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.481182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.481182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.481446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.481731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.486220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.488864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.491161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.491444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.491732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.492118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.492896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.493967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.494161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.494434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.494727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.518266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.519258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.519735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.520013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.520785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.521069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.524646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.524927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.525209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.525711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.525998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.526289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.531833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.532116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.533110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.533402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.536342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.536626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.536913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.537193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.537465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.537803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.537888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.537960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.538985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.539233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.539505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.554822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.555118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.556154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.556454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.559032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.561023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.562749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.563042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.564196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.564499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.567436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.568956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.570649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.572226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.573860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.574160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.574464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.574757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.575077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.575372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.575471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.575752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.576064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.576368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.576652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.576938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.591355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.591644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.591913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.592183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.593036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.593335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.593608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.593935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.599132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.600682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.600955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.601081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.602699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.602983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.603787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.604067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.604353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.604640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.604931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.605844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.606664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.607026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.607401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.607692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.616953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.617229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.617509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.617792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.618076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.618352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.618656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.619235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.619525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.619823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.620101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.620392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.620687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.620964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.634763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.638106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.638700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.641047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.641710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.643722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.644728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.645230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.645517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.645799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.646329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.647932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.648232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.648518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.652311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.653964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.655093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.656708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.656914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.657203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.657483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.657751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.659693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.659981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.660273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.660552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.665787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.666073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.666354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.669142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.669435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.669735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.673750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.674027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.674315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.674621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.674889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.675168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.675442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.675713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.676087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.676367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.676647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 11:56:07.676782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.676898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.676981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.677183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.677377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.677465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.677529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.677737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.678013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.678291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.678598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.678983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.679283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.679572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.679848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.680119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.680384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 11:56:07.711754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5869cf9c0 pid: 80348 (default app) Aug 03 11:56:07.715391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cfb2-e467-41b8-aebb-67026d2a0ab8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:07.715708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cfb2-e467-41b8-aebb-67026d2a0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:07.715993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cfb2-e467-41b8-aebb-67026d2a0ab8 None None] PATH_INFO: `/v3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:07.722184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5869cf9c0 pid: 80347 (default app) Aug 03 11:56:07.724295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Aug 3 11:56:07 2022] GET /identity/v3/ => generated 255 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:15.652895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:15.653482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:15.653482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:15.657937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:56:15.663876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:15.664357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:15.664453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:15.750350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: INFO dbcounter [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] Registered counter for database keystone Aug 03 11:56:15.772046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG oslo_db.sqlalchemy.engines [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 11:56:15.778987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writer thread running {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 11:56:15.975741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG passlib.handlers.bcrypt [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80348) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 11:56:15.976158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG passlib.handlers.bcrypt [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80348) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 11:56:16.032263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:16.033841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:16.174066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 11:56:16.339803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:16.410058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: INFO dbcounter [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] Registered counter for database keystone Aug 03 11:56:16.432168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 11:56:16.443136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writer thread running {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 11:56:16.584609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7de67-579f-40fa-8dba-14da64257274 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:16.589243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:16.589971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:16.590301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:16.591098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:16.601592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:16.654367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 11:56:16.655087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c5afe-2e19-4ebd-a5ab-dce9b93bf283 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:16.666049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 3 11:56:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 11:56:16.675028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:16.690392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd9e9-2e0b-4a8f-819f-fbb5d3a82d05 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:16.695281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:16.696444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:16.696730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:16.697007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] PATH_INFO: `/v3/projects/fa9288278a154c5e9a414320fa6388fa` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:16.698573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa9288278a154c5e9a414320fa6388fa)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:16.750238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 11:56:16.750608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d3de4-a5b6-49ad-b38e-10239394c607 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:16.755475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Aug 3 11:56:16 2022] GET /identity/v3/projects/fa9288278a154c5e9a414320fa6388fa => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:18.812671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf109-fb79-4191-a048-686feefc1fa7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:18.813266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf109-fb79-4191-a048-686feefc1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:18.813266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf109-fb79-4191-a048-686feefc1fa7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:18.817392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:18.823759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:18.824289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:18.824420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:18.861227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:18.862957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:18.872502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 03 11:56:18.895905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf109-fb79-4191-a048-686feefc1fa7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:18.908650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf109-fb79-4191-a048-686feefc1fa7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:18.913000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:18.913635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:18.913926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:18.914206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:18.923983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:18.925603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe8e0-38ce-4564-97db-33336f640cb2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:18.935929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 3 11:56:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 11:56:18.941897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:18.952346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72b5b-38f2-4d7f-88da-7f435baadd56 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:18.956868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:18.957532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:18.957828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:18.958114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:18.959559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:18.961412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f636bf-3165-493e-8873-1fb11e118533 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:18.963078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Aug 3 11:56:18 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:21.226752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f148e-33ed-4449-a538-200742a378ac None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.227335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f148e-33ed-4449-a538-200742a378ac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.227766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f148e-33ed-4449-a538-200742a378ac None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.230254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:21.238427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.238969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.239315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.260595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:21.262741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:21.271730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f79-52a6-4fb3-912e-b3ae4ec0d246 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.272206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f79-52a6-4fb3-912e-b3ae4ec0d246 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.272634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214f79-52a6-4fb3-912e-b3ae4ec0d246 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.274228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:56:21.280613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.280984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.281328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.331167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 11:56:21.331611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 11:56:21.350691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:21.374318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:21.377511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:21.379200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:21.406299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:21.498841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1fe5-a706-4378-b1ee-387ce331bf53 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:21.508822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:21.532030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:21.543533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:21.544201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.544491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.544776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.558032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:21.567704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:21.569711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:21.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:21.575614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:21.672399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:21.685927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46032c7-0221-4371-9089-325d88decfa2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:21.688716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:21.694142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ae57-79fd-4a43-bdf9-2f1a20263e4e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:21.735963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:21.736519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.736804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.737084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.737824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:21.738137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:21.739606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:21.743148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:21.744660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:21.745166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:21.745668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:21.753716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:21.759032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:21.839791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:21.841492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:21.917706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5cdcc-0e99-41e2-8590-74fd16f56792 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:21.958162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 11:56:21.967386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:21.970848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:22.086995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:22.088090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:22.088090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:22.088265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:22.089502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:22.091609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:22.093473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:21 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:22.097956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58004-c5b4-49a1-bfd9-88495caf82e5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:22.099209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:22.115266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:22.140862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:22.141750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:22.142042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:22.142317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:22.170278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:22.171808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:56:22.191658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:22.193026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:22.194163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:56:22.194163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:56:22.194163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:56:22.194163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:22.194163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:56:22.199011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:22.209637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5d5b1-ff69-47b8-9695-cc94eb62baa2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:22.244983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:22.245653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:22.245906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:22.246183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:22.247977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:22.249423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:22.251060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:22.256946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:22.272537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:22.328133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f8aa-aab7-4edd-ba1c-d130cb54cf62 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:22.345388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:22.368634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:22.369699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:22.370216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:22.370762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:22.372571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:22.373141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:22.375845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f4fe8-cbb2-4b07-808e-3331e7692434 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:22.376479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310130b-e1b6-4c5d-9081-e6a60ee5f3a5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:22.399465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:22.420310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:22.420971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:22.421260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:22.421545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:22.422386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.domain.id=default, user.id=0ebcadb74d2c4d319371eb661691d94f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:22.422742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:22.424288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a7aa-bb5f-427c-8f0e-b24a90b98966 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:22.432327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 3 11:56:22 2022] GET /identity/v3/role_assignments?user.id=0ebcadb74d2c4d319371eb661691d94f&scope.domain.id=default&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 233 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:25.004980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc577e6-ef9f-487a-86df-a840dde3ab61 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.005801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc577e6-ef9f-487a-86df-a840dde3ab61 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.005801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc577e6-ef9f-487a-86df-a840dde3ab61 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.007247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:25.015537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.016321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.016321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.044742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:25.045976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:25.142860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:25.212046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc577e6-ef9f-487a-86df-a840dde3ab61 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:25.349785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc577e6-ef9f-487a-86df-a840dde3ab61 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:25.378102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:25.420764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:25.421420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.421711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.421992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.438646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-31d0c66a-4cad-4086-8dfe-dc8f36d84cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:25.445600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:25.447470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:25.449448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 12/24] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:25.455782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:25.549881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adc69a-b8bc-47b4-b104-dc5d383c9412 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.550332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adc69a-b8bc-47b4-b104-dc5d383c9412 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.550533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adc69a-b8bc-47b4-b104-dc5d383c9412 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.552135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 13/25] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:25.557193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e908a-095e-49ca-96a0-0507881d6ef9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.557537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e908a-095e-49ca-96a0-0507881d6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.557774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e908a-095e-49ca-96a0-0507881d6ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.599581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b58e908a-095e-49ca-96a0-0507881d6ef9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:25.600901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b58e908a-095e-49ca-96a0-0507881d6ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:25.616135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:25.693008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3625b3-9457-45ee-af6d-cc24910562e1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:25.800219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:25.800873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.801158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.801439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.802208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:25.803067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:25.804410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76991-907d-486d-bb62-0688b4477585 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:25.814016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 13/26] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:25.815365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290ac2-d581-4317-b257-c328eff8e85c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.815694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290ac2-d581-4317-b257-c328eff8e85c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.815923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72290ac2-d581-4317-b257-c328eff8e85c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.817599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:25.819193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7ede-5d62-4238-9366-8cfb2a5924bd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.819554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7ede-5d62-4238-9366-8cfb2a5924bd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.819905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7ede-5d62-4238-9366-8cfb2a5924bd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.821642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 15/28] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:25.822288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 14/29] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:25.829084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.829315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:25.829442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.829568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:25.829681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.830027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:25.850095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:25.851517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:25.940610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 16/30] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:25.941271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:25.980951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:25.982189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:26.040356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:26.061723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 15/31] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:26.062619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.084476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f235ea-8734-47e7-9f0b-7f66185027b2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.101812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:26.129626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.130756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.131058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.131618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.133149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.135514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.138216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 17/32] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:25 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:26.139787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.185389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3bd54-40be-4a86-bf66-a047e393ae44 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.239133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.239790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.240081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.240371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.241674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.243949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.272875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb342d-de8a-4236-8c73-601d5b101016 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.316113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.317030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.317543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.317899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.319184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.321135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.326634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:26.405184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 16/33] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 3 11:56:26 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:26.405184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.493255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 18/34] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 3 11:56:26 2022] POST /identity/v3/roles => generated 225 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:26.494798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.534396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:26.554881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba4b83-7720-428f-97ab-f366249bfbe4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.650385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.651115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.651408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.651693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.667869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.671600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0deea7c5-2dd3-46bc-8e12-9f3e6cfb47bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:56:26.689678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:26.690546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:26.691330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:56:26.691330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:56:26.691330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:56:26.691330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:26.693385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 17/35] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:26.695322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e3fc-e8cb-44a2-996f-746d1fcd7b9d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.695858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e3fc-e8cb-44a2-996f-746d1fcd7b9d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.696331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e3fc-e8cb-44a2-996f-746d1fcd7b9d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.697932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:26.705694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e3fc-e8cb-44a2-996f-746d1fcd7b9d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.718809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5818cc3-1a24-4521-923c-6a974178534c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.776007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.776725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.777737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.777737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.783786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.785452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c451-9ff5-4c58-b797-355b4e1872e7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.787469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 19/37] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:26.788652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.789385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.789385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.813258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:26.814870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:26.891949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e3fc-e8cb-44a2-996f-746d1fcd7b9d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:26.905430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:26.932820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:26.932820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.946930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:26.948112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:26.948471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:26.948991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:26.951000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:26.951643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:26.954619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:26.978871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 19/39] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:26.978871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:26.991498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:27.106420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cd173-76a6-49d0-b5dd-044a485579f5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:27.124922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73d2a-9b09-4a7f-a0f4-68f6cc6d9762 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:27.148678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:27.149521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.149935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.150523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] PATH_INFO: `/v3/domains/default/users/0ebcadb74d2c4d319371eb661691d94f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.152973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0ebcadb74d2c4d319371eb661691d94f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:27.154603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:27.166759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:27.167412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.167705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.168512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.169261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:27.170747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671ef4-1ca9-45a7-a5db-baf0e71c1437 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:27.172761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 21/40] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Aug 3 11:56:26 2022] PUT /identity/v3/domains/default/users/0ebcadb74d2c4d319371eb661691d94f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:56:27.174060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:27.199488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 3 11:56:26 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:27.200901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f488-8437-4978-b08a-f7887d040566 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.201209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f488-8437-4978-b08a-f7887d040566 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.201476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78f488-8437-4978-b08a-f7887d040566 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.203322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 21/42] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:27.209156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.210791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.210791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.248375 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:27.250333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:27.284034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:27.382371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:27.392018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd507c5-67a5-4350-be49-846135ae14eb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:27.396845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:27.436883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:27.437608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.438859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:27.441024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.441357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.442098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:27.443736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:27.489378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:56:27 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:27.597996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112db84-8c2d-4f2a-b569-5e1856205d40 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:27.651661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:27.653091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.653512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.653922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.655840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:27.657516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72488f81-081d-4d7f-9bb1-2fe8a1814427 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:27.659844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 23/45] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:27.666401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:27.829934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4aeab-70ad-43d7-b1d6-b2066b7bac15 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:27.833085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:27.874681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:27.875489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:27.875908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:27.876302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:27.877166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:27.878836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6d6c9-7ae2-4c5b-a03d-8daca01eaeb5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:27.911871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:56:27 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:56:29.564735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba570-1b50-46ab-94d4-0e94a69d86bd None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:29.565314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba570-1b50-46ab-94d4-0e94a69d86bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:29.565314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba570-1b50-46ab-94d4-0e94a69d86bd None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:29.566918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 24/47] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:29.572478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:29.572998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:29.573170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:29.594477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:29.595701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:29.666970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 24/48] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:29.689902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba570-1b50-46ab-94d4-0e94a69d86bd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:29.764285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:29.802476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba570-1b50-46ab-94d4-0e94a69d86bd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:29.838127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:29.838811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:29.839102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:29.839387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:29.850336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:29.855852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:29.856826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:29.857941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 25/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:29.864242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:29.955836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:29.974216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ad8a-4078-4585-a57f-149897271916 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.016925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.017832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.018219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.018542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.019301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:30.019616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.021076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145538a0-a61e-4f12-93a2-d95478da425a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.031158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 25/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:30.037222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:30.105205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2fcd-94a3-4791-a401-f60580cce19a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.106045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2fcd-94a3-4791-a401-f60580cce19a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.106333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2fcd-94a3-4791-a401-f60580cce19a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.107779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 26/51] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:56:30.113589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.113878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.114169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.134613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:30.135837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:30.156081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e217-f8d5-4337-8c62-d104bdb7f858 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.192778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:30.203231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.203906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.204186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.204463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.205947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.207487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.209162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 26/52] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:30 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:30.214854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:30.218173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 27/53] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:30.241614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:30.332874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:30.336672 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aec5-8354-43fc-917b-90a19596bec5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.357744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a82c0-4cc2-4a45-b53c-b6f85347e1ab None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.380961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.382065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.382530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.382970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.384478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.386005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.388024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 27/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:30.395390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:30.410771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.411801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.412260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.412712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.414490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.416907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.420744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:30.427644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:30.492935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:30.544723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae1ad-bda6-465b-88b7-b3aab2b89c1f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.556346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895a0b-8e2d-49b3-90fc-e8406f6826a7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:30.583801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.584636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.584783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.585084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.586142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.domain.id=default, user.id=0ebcadb74d2c4d319371eb661691d94f) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:30.588073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.588959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a37299-bb74-49e0-a67a-65098b989fae None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.597528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:30.598307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:30.598477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:30.598762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:30.599458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:30.600967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc9ce-42fe-4d40-98ef-6375d2d0d7e8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:30.601488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 28/56] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 3 11:56:30 2022] GET /identity/v3/role_assignments?user.id=0ebcadb74d2c4d319371eb661691d94f&scope.domain.id=default&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 530 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:30.628453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:30.642503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 29/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 3 11:56:30 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:56:32.790151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bbc4-a61a-4752-98cd-00c4245c9a93 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:32.790752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bbc4-a61a-4752-98cd-00c4245c9a93 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:32.790752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bbc4-a61a-4752-98cd-00c4245c9a93 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:32.792117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 29/58] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:32.797780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:32.798307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:32.798391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:32.823039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:32.825045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:32.898318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 30/59] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:32.922979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604bbc4-a61a-4752-98cd-00c4245c9a93 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:33.038580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604bbc4-a61a-4752-98cd-00c4245c9a93 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:33.074056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:33.086170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:33.087023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:33.087430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:33.087770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:33.089190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:33.090980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ba0b7-667b-4311-add6-3070531dcbd1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:33.092837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 30/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:33.098944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:33.211836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e00a-8073-4c23-bb3d-108d77d00298 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:33.240306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:33.249361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:33.250001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:33.250291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:33.250607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:33.251319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:33.252815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1be87-28fb-472b-8786-581f36c94c4b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:33.282231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 31/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:56:33 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:37.045178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35cb1c-b934-46e1-afec-d551f45d6cc8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.046816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35cb1c-b934-46e1-afec-d551f45d6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.047655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35cb1c-b934-46e1-afec-d551f45d6cc8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.050531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 31/62] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:37.059769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cffa7-5f34-4586-bad4-81e1412f519f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.061241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cffa7-5f34-4586-bad4-81e1412f519f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.062064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cffa7-5f34-4586-bad4-81e1412f519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.108391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-da4cffa7-5f34-4586-bad4-81e1412f519f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:37.110980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-da4cffa7-5f34-4586-bad4-81e1412f519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:37.267092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 32/63] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:37.341869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35cb1c-b934-46e1-afec-d551f45d6cc8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:37.510510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35cb1c-b934-46e1-afec-d551f45d6cc8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:37.545883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4320-f0e3-4efe-b017-0c80f21082d6 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.546411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4320-f0e3-4efe-b017-0c80f21082d6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.546863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4320-f0e3-4efe-b017-0c80f21082d6 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.548432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 33/64] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:37.557106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cc308-741c-4c38-8395-c5e179314c86 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.557652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cc308-741c-4c38-8395-c5e179314c86 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.558084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cc308-741c-4c38-8395-c5e179314c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.568940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:37.569612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.569900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.570182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.592050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:37.603647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c33cc308-741c-4c38-8395-c5e179314c86 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:37.605013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c33cc308-741c-4c38-8395-c5e179314c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:37.605423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:37.606227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:37.606988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:37.609432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 32/65] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:56:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:37.617904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:37.741145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 34/66] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:37.756124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9f39-68a2-4aed-8160-7c573e1b0f0d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.757577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9f39-68a2-4aed-8160-7c573e1b0f0d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.758361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9f39-68a2-4aed-8160-7c573e1b0f0d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.762129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 35/67] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:56:37.772231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9f39-68a2-4aed-8160-7c573e1b0f0d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:37.794257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:37.863315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504e3e-61fd-4132-a1b1-bce5300a0cd6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:37.888018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:37.928153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:37.928802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.929096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.929384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.930142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:37.930553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:37.932013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5c25-7152-4598-8bdc-7fa49f6d91c3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:37.945067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 33/68] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:56:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:37.946376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85cb62-9519-4fb6-bb8a-1111063c5993 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:37.946708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85cb62-9519-4fb6-bb8a-1111063c5993 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:37.947004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85cb62-9519-4fb6-bb8a-1111063c5993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:37.968751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4e85cb62-9519-4fb6-bb8a-1111063c5993 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:37.970829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4e85cb62-9519-4fb6-bb8a-1111063c5993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:37.977674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9f39-68a2-4aed-8160-7c573e1b0f0d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.022311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.023313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.023592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.023881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.044190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-dd2c8784-d743-49da-9c4d-05704b2896b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:38.056261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:38.057153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:38.057887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:38.059705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 36/69] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:38.061923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c9f3-2bc3-4ce1-b1b9-1559cda96694 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.062574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c9f3-2bc3-4ce1-b1b9-1559cda96694 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.062931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c9f3-2bc3-4ce1-b1b9-1559cda96694 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.069991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 37/70] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:38.069991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c9f3-2bc3-4ce1-b1b9-1559cda96694 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.110521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 34/71] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:38.110521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.110521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.110521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.142516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:38.144316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:38.211626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.254628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 35/72] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:38.255914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.276897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c9f3-2bc3-4ce1-b1b9-1559cda96694 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.282554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.329323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.330155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.330611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.331047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.349353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:38.351418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:38.353862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 38/73] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:38.354859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.456102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bdf3e-c4fb-43a5-aabb-e02462308305 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.507715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.508470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.508839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.509213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.510031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:38.510424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:38.512277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:38.512729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2145-3b32-4e46-aee3-cbd3ec1a1d1c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.522276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 36/74] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:38.523730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.557566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.559218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.559669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.560124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.577213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:38.585754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:38.586831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:38.587727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:38.588291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 39/75] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:38.588824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.589847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.636713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.681486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde1f-310d-4356-a203-47db36af5b04 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.721378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.722009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.722427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.722850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.724270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:38.725945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b710f-1499-49dc-8d6f-2f31fa6e4add None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:38.727875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 37/76] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:38.734115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92242-5db0-4f71-b541-88a2e46c8c3b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.734894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92242-5db0-4f71-b541-88a2e46c8c3b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.735252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c92242-5db0-4f71-b541-88a2e46c8c3b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.736254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b960-ba71-4141-a774-91c8cb6200c2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.736820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 38/77] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:38.737739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c92242-5db0-4f71-b541-88a2e46c8c3b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:38.788691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.790684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.791150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.791606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.885412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c92242-5db0-4f71-b541-88a2e46c8c3b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:38.890641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:38.893204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:38.898800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.931725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:38.941983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:38.942871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:38.943204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:38.943526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:38.944913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:38.946911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:38.949006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 39/78] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:38.955470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.041868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 40/79] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:39.041868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.082077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec6d9-0af5-441f-a96d-7d0cbbc8f546 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:39.119397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:39.120340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.120340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.120614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.121334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:39.121657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:39.123079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9084c-4b14-4710-b324-a4861286caae None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:39.132284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 40/80] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:39.133584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.133958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.135842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.166195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:39.168199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:39.182185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780007-527f-49cb-978b-8009422d6e02 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:39.217551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:39.221780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:39.236222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:39.236878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.237168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.237458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.238176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:39.239730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:39.266418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 41/81] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:56:39 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:39.268000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.278819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 41/82] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:39.280403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.461128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464882-5c88-4580-9ed8-8cc88db26dbe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:39.482874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29417f-2bde-4bdb-8a8d-57f17081bb83 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:39.520658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:39.521637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.522091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.522589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.531438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:39.532480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.532948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.533412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.535959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:39.537789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:39.543724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 42/83] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:39 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:39.543724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.608013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:39.617534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:39.663318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:39.665518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:39.739117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5f69f-0a0f-4c6c-a1df-dda5fff1f959 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:39.805274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 42/84] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:39.806279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.820094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:39.821432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:39.822079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:39.822631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:39.828198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:39.833303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:39.836900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 43/85] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:39 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:39.838900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:39.904107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:39.948186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a01370-a2af-4ef5-83be-ad06c18995ae None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.003525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29e18-1c9d-494f-ac95-0c14ebf15348 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.005711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:40.030655 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.031839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.032383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.033070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.055385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.056384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.056812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.057232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.059140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:40.059617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:40.059746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:40.061354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:40.068275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 44/86] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:39 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=a459998da52847ad9ba273f6520dabca => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:40.069350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:40.072487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:40.073482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:40.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:40.076884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 43/87] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:40.080034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.236772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc4b24-6738-43c1-885b-9a677264e473 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.286193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.287245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.287926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.289262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.307045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:40.396530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48b54-1a7a-4e50-826b-09d8d3290013 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.397283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:40.399251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:40.523919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 44/88] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:40.525040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.543881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.544766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.545162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.545552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.550854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:40.552458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:40.554325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 45/89] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:40.555241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.574480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:40.644091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee7d-9dfb-470d-87f8-0337b95d97ad None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.685792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.686952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.687386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.687810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.688692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:40.689350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:40.690965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:40.691073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:40.702734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 45/90] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:40.704340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.813630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7577e-ca6b-40c4-9079-a8667b4e33c1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:40.881494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:40.882163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:40.882477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:40.882759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:40.883964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:40.891952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:40.893874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 46/91] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:40.896330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:40.962562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:40.966905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf7ef-a086-42cb-8762-14a5160a6d6b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:41.007030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:41.008346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:41.008650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:41.008946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:41.009779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:41.010116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:41.011966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:41.019127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 46/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:41.020561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:41.153790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4535-08d8-4cde-bcac-e4890c95a55f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:41.159771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:41.224042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:41.224732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:41.225021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:41.225302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:41.230764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:41.231044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe143-d134-479b-a297-8111d5b1eb40 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:41.232476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:41.234304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 47/93] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:40 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:41.242780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:41.342316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:41.342316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:41.342316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:41.342316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:41.343065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=0ebcadb74d2c4d319371eb661691d94f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:41.343065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:41.343065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:41.356255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 47/94] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:41 2022] GET /identity/v3/role_assignments?user.id=0ebcadb74d2c4d319371eb661691d94f&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:41.493574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6e384-682d-456c-9db9-df142e853fb9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:41.564402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:41.565104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:41.565353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:41.565695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:41.646934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:41.685541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:41.687717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:41.928593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 48/95] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:41.938064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:41.983532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:42.066114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8500a5-0751-49ca-98f2-7cc5bde49403 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:42.108392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:42.109070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:42.109370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:42.109647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] PATH_INFO: `/v3/projects/8f67319e3a61460c928c010b02ef0a14` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:42.110936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8f67319e3a61460c928c010b02ef0a14)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:42.112447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131a77-5f8f-4f29-9ffc-f2e0306336c8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:42.114776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 48/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:41 2022] GET /identity/v3/projects/8f67319e3a61460c928c010b02ef0a14 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:42.122259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:42.273309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:42.317046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c25c9-d794-4b44-9e2d-87a572c2fe64 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:42.350287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5445-ef58-41fb-8d23-90ac91d2ca03 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:42.351815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5445-ef58-41fb-8d23-90ac91d2ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:42.352596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5445-ef58-41fb-8d23-90ac91d2ca03 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:42.355973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 49/97] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:42.362714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:42.363357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:42.363657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:42.363932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:42.364743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=8f67319e3a61460c928c010b02ef0a14, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:42.365060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:42.366230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:42.366587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:42.367309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:42.368086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:42.378574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 49/98] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:42 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=8f67319e3a61460c928c010b02ef0a14&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:42.408306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:42.411057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:42.576650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 50/99] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:42.616726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:42.831581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba985c09-7ef2-4d44-b9ae-a3b8bf7c4a9c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:42.896272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:42.897496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:42.897998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:42.898613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:42.900770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:42.904105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5284b-4663-4ea8-b870-47ad90b89020 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:42.907748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 50/100] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:42.917096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:42.972506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:43.117462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b95e-317b-421c-813e-f6734d76585b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:43.187337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:43.188000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:43.188363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:43.188695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:43.189432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:43.191580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930251-fcce-4118-b916-8928bde1e5b1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:43.251724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 51/101] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:56:42 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:43.567235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9ec8-97dc-4279-a06b-cf4a2b04631b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:43.568101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9ec8-97dc-4279-a06b-cf4a2b04631b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:43.568886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9ec8-97dc-4279-a06b-cf4a2b04631b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:43.571422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 51/102] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:43.590065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d387-1d35-4901-8103-607643c8837a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:43.591691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d387-1d35-4901-8103-607643c8837a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:43.592230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d387-1d35-4901-8103-607643c8837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:43.624013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-83a5d387-1d35-4901-8103-607643c8837a None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:43.626654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-83a5d387-1d35-4901-8103-607643c8837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:43.754582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 52/103] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:43.795234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9ec8-97dc-4279-a06b-cf4a2b04631b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:43.800248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:43.973102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63976f-7ad3-4d3b-ae9c-f4eec2c0179a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:43.973614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63976f-7ad3-4d3b-ae9c-f4eec2c0179a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:43.974482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63976f-7ad3-4d3b-ae9c-f4eec2c0179a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:43.978354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 53/104] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:43.994249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:43.995675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:43.996497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.068159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:44.070144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:44.079180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:44.087753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9ec8-97dc-4279-a06b-cf4a2b04631b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:44.219692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:44.220861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:44.221377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:44.221909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.262862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:44.274273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:44.276074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:44.278199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:44.280301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 54/105] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:44.284772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 52/106] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:44.295134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:44.325499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:44.459772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:44.537792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314ec6d-7c1f-41ba-8d0d-6b739b83ca57 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:44.549385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836642a4-a93d-4e90-83fc-76257f11760f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:44.671694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:44.672775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:44.673346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:44.673861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.675225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:44.675764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:44.679136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c183b-5d00-40fe-98c6-eaeddf736747 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:44.685962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:44.687155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:44.687669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:44.688164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.706852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:44.718416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 55/107] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:44.720862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823888-07d6-4e0e-9f60-b5af3c55e1b8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:44.721402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823888-07d6-4e0e-9f60-b5af3c55e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:44.721921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823888-07d6-4e0e-9f60-b5af3c55e1b8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.731736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:44.743068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:44.744088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:44.744803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:44.746494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 53/108] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:44.747763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 56/109] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:44 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:44.748569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:44.760086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:44.760626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:44.761152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:44.811632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:44.813031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:44.944492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fe2e9-0d0b-4639-a2f9-5a72b23901bf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:44.969311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:44.970523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:44.971810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.005074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.006137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.007361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.007871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] PATH_INFO: `/v3/users/776f80da694249c29198698dfadbd2f1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.052597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] RBAC: Authorizing `identity:get_user(user_id=776f80da694249c29198698dfadbd2f1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:45.055669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:45.059577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:44 2022] GET /identity/v3/users/776f80da694249c29198698dfadbd2f1 => generated 289 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:45.061310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.221202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b326-9011-43e8-97c0-7ed20e6cd5ed None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:45.237201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85944eb9-a266-4bd9-94a5-8388c71c4e51 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:45.261720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.262373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.262719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.263007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.264602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:45.270754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:45.272426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:45.274035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:45.285610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.286124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.286412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.286728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.296682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 58/112] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:56:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:45.298621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.305940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-67b70f6e-d049-402d-843b-1b1811b1c359 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:45.312757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:45.314318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:45.315833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:45.318887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 55/113] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:45.320335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ad9b-6150-4858-94db-06965dc4a267 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.320633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ad9b-6150-4858-94db-06965dc4a267 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.320919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ad9b-6150-4858-94db-06965dc4a267 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.326660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 56/114] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:45.328856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ad9b-6150-4858-94db-06965dc4a267 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.402369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:45.484079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb43ec-f8a4-4338-9514-d6ffa7237810 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:45.530156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.531211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.531706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.532199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.534352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ad9b-6150-4858-94db-06965dc4a267 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:45.580056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.580714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.580998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.581277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.582510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:45.583967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:45.585788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 57/115] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:45.586528 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.622538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:45.639972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:45.642651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba7767-89a7-4d97-a92e-3e2beec604dd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:45.698301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8ecac-d775-4c98-a72c-9c59b9494dbb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:45.708979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:45.742824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:45.743388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.743677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.743956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.744680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:45.744993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:45.746927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f9c0e-7cc3-43cc-a612-bd3b164e1a55 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:45.758163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 58/116] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:45.759389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.759764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.760052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.782318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:45.783583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:45.801436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:45.803846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f7b35-73e0-4900-883a-35b2e9148dd1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:45.804572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f7b35-73e0-4900-883a-35b2e9148dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:45.805005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f7b35-73e0-4900-883a-35b2e9148dd1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:45.811356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 60/118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:45.812332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f7b35-73e0-4900-883a-35b2e9148dd1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.877180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 59/119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:45.880981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:45.941109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:45.955946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f7b35-73e0-4900-883a-35b2e9148dd1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.018981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.020030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.020487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.020894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.022904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.025562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.028926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 61/120] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:46.029728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.080800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:46.085266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9a61d-e988-4ab2-8494-b3e2844f65de None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.132978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.134061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.134618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.135223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.137955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.140915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d402e8e-b152-4cef-be48-16f4ffe4a8c1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.148359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 60/121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:45 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:46.148359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.148359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.148359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.184292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:46.186020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:46.223153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8efd8-f5e9-4c37-a794-dd3d8fb6e9ca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.288920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.290018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.290563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.291080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.293514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.295058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 61/122] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:46.296482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.308013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 62/123] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:46.308013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.309699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.369181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:46.465313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dee1f-8281-464a-a7ae-393b97183159 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.484704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:46.492057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e06a6-0602-4cc0-9f1a-65603292ab0b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.508921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.509765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.510151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.510554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/b5fd614718af4cdba982df4dd3b59b00/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.513907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, user_id=b5fd614718af4cdba982df4dd3b59b00, role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.515611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.532918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 63/124] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:56:46 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/b5fd614718af4cdba982df4dd3b59b00/roles/a459998da52847ad9ba273f6520dabca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:56:46.534537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.588785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.589739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.591074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.591413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.608887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:46.616065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:46.617709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 62/125] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:46.620208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.664188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:46.683720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913279-24fb-4323-835a-8497cee2ac6a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.745443 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.746820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.747157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.748150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.749546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.751984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.753867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 64/126] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:46.755634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.803035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba2e0c-a27e-485a-b23f-5bff34a7fcfa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.866650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.867616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.868130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.868638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.870117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=776f80da694249c29198698dfadbd2f1) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:46.871293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:46.873955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:46.882748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad08954-bb96-4c62-9937-b53c37e65c3d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:46.883921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 63/127] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/role_assignments?user.id=776f80da694249c29198698dfadbd2f1&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:46.885434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.934862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:46.935863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:46.936338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:46.937020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:46.937460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:46.951974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:46.957806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:46.958784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:46.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:46.961787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 65/128] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:46.962919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:46.991977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:47.066212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65641474-5cbe-4496-bdd0-9d1e3c207c44 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:47.113506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:47.114315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.114539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.114932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.115579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:47.115894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:47.117404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da869d0-8c41-454b-9f75-cabe54ae6f47 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:47.124016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afcdd5-4e8c-425a-a5cc-0751e8cb6960 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:47.127899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 64/129] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:47.129514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049b54-17f8-411f-b011-f5a42605e30a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.129835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049b54-17f8-411f-b011-f5a42605e30a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.130120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049b54-17f8-411f-b011-f5a42605e30a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.131518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 65/130] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:47.132271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049b54-17f8-411f-b011-f5a42605e30a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:47.166900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:47.168523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.169089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.169573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/b5fd614718af4cdba982df4dd3b59b00/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.171970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, user_id=b5fd614718af4cdba982df4dd3b59b00, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:47.173929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd081-ce51-4375-8173-1e691c42254f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:47.195019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:56:46 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/b5fd614718af4cdba982df4dd3b59b00/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:56:47.196750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.197321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.198383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.246555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:47.247798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:47.255043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:47.282001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049b54-17f8-411f-b011-f5a42605e30a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:47.352134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:47.353305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.353902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.354393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.358546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:47.359112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:47.361790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:47.377946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 66/132] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:47.379397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:47.443751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 67/133] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:47.444391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:47.463545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:47.608944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dce208-e4a0-48a5-a54a-781591a3c4fd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:47.613680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5513a-736a-4991-8779-e75449e8f025 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:47.688520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:47.690680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.692302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.693868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.697572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:47.701845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:47.703290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:47.704719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:47.705484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:47.706293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:47.710578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 68/134] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:47 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:47.712231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:47.715161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:47.716816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:47.720350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 67/135] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:47 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:47.722668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:47.755033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:47.985752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:48.003261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e5735-3699-4f29-a85e-96787d7bfd17 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.052921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c0c33-1b0b-4e5e-af68-d32b79de94d2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.071612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.072338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.072627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.072910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] PATH_INFO: `/v3/projects/8f67319e3a61460c928c010b02ef0a14` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.074937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] RBAC: Authorizing `identity:get_project(project_id=8f67319e3a61460c928c010b02ef0a14)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.078043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.079742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 68/136] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:47 2022] GET /identity/v3/projects/8f67319e3a61460c928c010b02ef0a14 => generated 312 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:48.080556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:48.179315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.180003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.180302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.180596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.187412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.188947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.190715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 69/137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:48.191494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:48.250856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:48.278192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab8d76-bff5-427c-945e-373851063c68 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.330236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23945e-d888-4ec4-9986-fda5a628d857 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.373862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.374856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.375375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.375702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] PATH_INFO: `/v3/projects/8f67319e3a61460c928c010b02ef0a14/users/b5fd614718af4cdba982df4dd3b59b00/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.378888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f67319e3a61460c928c010b02ef0a14, user_id=b5fd614718af4cdba982df4dd3b59b00, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.380829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.405758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 70/138] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:56:48 2022] PUT /identity/v3/projects/8f67319e3a61460c928c010b02ef0a14/users/b5fd614718af4cdba982df4dd3b59b00/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:56:48.407020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.407367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:48.408333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.408849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.409359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.415109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:48.418708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.422974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.433991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 69/139] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:48 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:48.440177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:48.594230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736279-b386-47f3-a434-d43c90b61b63 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.642472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.642472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.642472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.642472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.643076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.643076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87f7fa-310f-4cbe-8d03-e29f2b5743d4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.675101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 71/140] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:56:48 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:48.693729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996a52-9a6e-4988-9db6-38327e47461a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:48.735418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:48.736132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:48.736423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:48.736715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/0ebcadb74d2c4d319371eb661691d94f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:48.738835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, user_id=0ebcadb74d2c4d319371eb661691d94f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:48.740344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b1da-0ad4-4935-9cb0-58cb073d871f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:48.757960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 70/141] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:56:48 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/0ebcadb74d2c4d319371eb661691d94f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 11:56:49.535023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624b7-bdab-451e-9e75-af961be83dd1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:49.535807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624b7-bdab-451e-9e75-af961be83dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:49.535807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624b7-bdab-451e-9e75-af961be83dd1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:49.537351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 72/142] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:49.543312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:49.544026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:49.544026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:49.564192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:49.565417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:49.568746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:49.696080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:49.727647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2624b7-bdab-451e-9e75-af961be83dd1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:49.821760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:49.880263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2624b7-bdab-451e-9e75-af961be83dd1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:49.931405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:49.932096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:49.932395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:49.932688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:49.949751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:49.956158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:49.957423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:49.959401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 73/144] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:49.963662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:50.113053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b7b5-bf34-4822-98af-beeb92ee52d1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:50.168404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:50.169066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:50.169357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:50.169640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:50.170411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:50.170755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:50.172314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915bb0-9554-4b41-9272-f034a186556f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:50.187569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 72/145] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:50.193338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:50.256441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843464-f766-4e2a-8468-c31107c4ddbf None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:50.257068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843464-f766-4e2a-8468-c31107c4ddbf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:50.257068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843464-f766-4e2a-8468-c31107c4ddbf None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:50.258892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 73/146] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:56:50.272759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:50.273149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:50.273396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:50.293558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:50.309576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:50.310834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:50.390012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a96731-f93e-458d-94d4-14091bae4d81 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:50.432011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:50.475229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:50.475944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:50.476215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:50.476499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] PATH_INFO: `/v3/users/776f80da694249c29198698dfadbd2f1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:50.483486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] RBAC: Authorizing `identity:get_user(user_id=776f80da694249c29198698dfadbd2f1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:50.485539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:50.487467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 74/147] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:50 2022] GET /identity/v3/users/776f80da694249c29198698dfadbd2f1 => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:50.494621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:50.495609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:50.536746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:50.783717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92cb9-ab0c-455d-9015-db44d8f89858 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:50.887917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d193b-56a7-4029-9524-6554639f6e30 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:50.919680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:50.921117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:50.921840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:50.922575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:50.924964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:50.928025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:50.931564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 75/149] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:50 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:50.938961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:50.983182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:51.000928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:51.002362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.003042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.006476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.044397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:51.059069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:51.060991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:51.062693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 75/150] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:56:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:51.072770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:51.140624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:51.286009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a92c4c-a311-4ffa-bfee-674ef7284ef4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:51.312052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba985fe-56f1-4d9c-9eca-0fae206e0be8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:51.364558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:51.365547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.366006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.366912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.367831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:51.368322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:51.369930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:51.386901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 76/151] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:51.388947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:51.466481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:51.467916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.468685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.469389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/776f80da694249c29198698dfadbd2f1/roles/81e19493c60b4327ada6a0ab081e9b25` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.478390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:51.487160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, user_id=776f80da694249c29198698dfadbd2f1, role_id=81e19493c60b4327ada6a0ab081e9b25)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:51.490017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87c28-1af6-4b83-a376-748312637840 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:51.538647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 76/152] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:56:50 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/users/776f80da694249c29198698dfadbd2f1/roles/81e19493c60b4327ada6a0ab081e9b25 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:56:51.549835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f197c0-b534-4f7f-a80f-7e59bc12742f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:51.592718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734b113-1a53-4f2a-9ce4-bca16a836f30 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.593527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734b113-1a53-4f2a-9ce4-bca16a836f30 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.594245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734b113-1a53-4f2a-9ce4-bca16a836f30 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.603805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 77/153] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:51.606488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:51.607175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.607463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.607744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.615288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.615550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:51.616252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.616947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.617141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:51.618780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 77/154] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:51 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:51.628150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:51.668213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:51.669516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:51.785520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb2ce-896e-4ff0-ae1b-23e241096f5c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:51.849589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:51.851642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 78/155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:56:51.887035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:51.888122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:51.888984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:51.889269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:51.895877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:52.008861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:52.079543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:52.083163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:52.126872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a5017-9c0b-492a-bd79-4de7145abd4e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:52.187435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:52.188103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:52.188403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:52.188693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:52.231550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:52.237001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:52.238351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:52.239209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:52.247928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 79/156] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:52.250089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:52.345996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 78/157] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 11:56:52.354106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:52.430771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:52.566675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21414-b754-4619-8ab0-db1f056cbe19 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:52.571583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:52.625492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59a3e-08ea-4357-9f4a-3a38d0dd077f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:52.630494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:52.631649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:52.632180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:52.632887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:52.634288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:52.634863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:52.637241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:52.649089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 80/158] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:52.668550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:52.684835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:52.685407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:52.685694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:52.685976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:52.687870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:52.689358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:52.696885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 79/159] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:52 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:52.699483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:52.936908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf55c-6cd6-4e24-a4bb-c7e9053903a3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:52.951694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:52.997226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e536ca-42dc-4395-85de-cc5e24ac44e2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:53.020737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:53.021614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.021922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.022192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.027487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:53.030063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7c550-e871-4a78-81c6-f527e08344fd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:53.032519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 81/160] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:52 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:53.034037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2820b5-9064-450f-9ae4-74c9ac275761 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.034502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2820b5-9064-450f-9ae4-74c9ac275761 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.035022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2820b5-9064-450f-9ae4-74c9ac275761 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.038542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 82/161] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:53.044498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2820b5-9064-450f-9ae4-74c9ac275761 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:53.099314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:53.099986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.100274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.100556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.101372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:53.101692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:53.103226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eaab6-9d82-4e80-9c7f-d0fcb5b1f106 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:53.112726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 80/162] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:52 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=a459998da52847ad9ba273f6520dabca => generated 608 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:53.114040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.114531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.114956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.119612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:53.154587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:53.155828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:53.285974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2820b5-9064-450f-9ae4-74c9ac275761 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:53.363309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:53.364102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.364400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.364692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.365263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 81/163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:53.408153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:53.488518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:53.490282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:53.539526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:53.637418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 83/164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:53.643731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:53.700859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:53.760751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704c5a-a8d1-4e04-828a-d389d805240f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:53.804265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74fe2-aead-491c-9ae6-3721398fa694 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:53.873933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:53.875091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.875589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.876038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.878232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:53.881442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c687c97-04fd-4341-982f-dfb7a6f2150f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:53.883899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:53.884576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.884866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 84/165] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:53 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:53.885191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.885482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.893154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850c52-9e74-4474-bf87-7abfe889612a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.893672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850c52-9e74-4474-bf87-7abfe889612a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.894176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850c52-9e74-4474-bf87-7abfe889612a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.897012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 85/166] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:53.898370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850c52-9e74-4474-bf87-7abfe889612a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:53.906599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:53.918458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-87773845-6542-48df-80a8-d8ed757d92b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:53.923621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:53.924575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:56:53.925520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:53.930819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 82/167] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:53.932283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:53.932575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:53.932893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:53.967569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:53.968798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:54.132549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850c52-9e74-4474-bf87-7abfe889612a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:54.160641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 83/168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:54.161331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:54.211258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:54.211916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.212213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.212571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.213303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:54.213622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:54.216053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:54.226806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 86/169] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:53 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:54.233511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:54.360709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:54.404727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:54.486042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187177e-9947-48df-9669-24a1d90ff4fc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:54.497426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94f4c0-249f-4304-9499-7d9b223d29f6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:54.590027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:54.591147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.591635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.592125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.611896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:54.611896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.612165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.612456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.613220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:54.613537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:54.615018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:54.618716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2f93b0a1-d042-409b-b353-8a24923cfd96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:54.625383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:54.626320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:54.627202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:54.631845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 87/170] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:56:54.633873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481aec1-ca08-429f-a036-db5066db5f18 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.634399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481aec1-ca08-429f-a036-db5066db5f18 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.634904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481aec1-ca08-429f-a036-db5066db5f18 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.637465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 88/171] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:54.640541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 84/172] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:54.645278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481aec1-ca08-429f-a036-db5066db5f18 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:54.646567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:54.895169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481aec1-ca08-429f-a036-db5066db5f18 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:54.903911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7efba-3a64-4ff1-b5e9-bc5df87d87d7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:54.958387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:54.959513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.960007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.960504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:54.961337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] PATH_INFO: `/v3/users/b5fd614718af4cdba982df4dd3b59b00` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.963056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] RBAC: Authorizing `identity:get_user(user_id=b5fd614718af4cdba982df4dd3b59b00)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:54.964664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b382c18-9fb2-484a-ac09-158d4be3f059 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:54.966849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 85/173] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:54 2022] GET /identity/v3/users/b5fd614718af4cdba982df4dd3b59b00 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:54.967918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.968820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.968820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.982544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:54.983537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:54.984196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:54.984509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:54.984750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:54.986380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:54.986380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:54.987274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d0955-488c-4aad-b777-cfa5debf3ec5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:55.000815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:55.002030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:55.004323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 89/174] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:55.005420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdec7a6-b388-49c8-9e10-f5b5d4262e92 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.005701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdec7a6-b388-49c8-9e10-f5b5d4262e92 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.005987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdec7a6-b388-49c8-9e10-f5b5d4262e92 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.007895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 90/175] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:55.008699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdec7a6-b388-49c8-9e10-f5b5d4262e92 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.097480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 86/176] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:55.098112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.154582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdec7a6-b388-49c8-9e10-f5b5d4262e92 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:55.204049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:55.204693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.204967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.205248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.237168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f69d1-4b02-4842-84c5-8c05171f33b7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:55.277824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:55.278567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.278857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.279194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] PATH_INFO: `/v3/users/0ebcadb74d2c4d319371eb661691d94f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.280673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0ebcadb74d2c4d319371eb661691d94f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:55.282155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a5c23-b997-4c7f-b903-e038ddbb03f2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:55.284289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 87/177] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/users/0ebcadb74d2c4d319371eb661691d94f => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:55.285526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.285812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.286148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.289723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.294182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.308793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:55.310059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:55.311145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:55.313130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:55.414555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 88/178] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:55.414555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.470046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 91/179] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:55.471262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.558098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d59f8-b0f0-4113-bc69-56ab982465ac None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:55.581309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.595849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761069c-99b6-4473-9d8c-52e197302f0e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:55.611519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.619154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:55.620177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.620882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.621668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.638780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:55.642729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:55.643365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.643653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.643934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e8a65a03-4270-4db2-a9cd-dc588cabcb77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:55.644267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:55.645938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 89/180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:55.647500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7614-dddc-46ae-9153-bedaf3162b8d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.648919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7614-dddc-46ae-9153-bedaf3162b8d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.648919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7614-dddc-46ae-9153-bedaf3162b8d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.654490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 90/181] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:55.654490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7614-dddc-46ae-9153-bedaf3162b8d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.743699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:55.746018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b80afb-c11e-40ec-8bbf-970b3ace0d23 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:55.799011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7614-dddc-46ae-9153-bedaf3162b8d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:55.851654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:55.852423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.852795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.853198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.854561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:55.856246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:55.858019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 91/182] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:55.859026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.868312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.885439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:55.888146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf98fb-8204-462d-b867-1f530cbeb869 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:55.888645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf98fb-8204-462d-b867-1f530cbeb869 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:55.889054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf98fb-8204-462d-b867-1f530cbeb869 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:55.890702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 93/184] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:56:55.891363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf98fb-8204-462d-b867-1f530cbeb869 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:55.938008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:55.989395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c73c-9bd1-4478-90bf-91abadda3e0b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.020001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf98fb-8204-462d-b867-1f530cbeb869 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.033710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.034563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.034955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.035352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] PATH_INFO: `/v3/projects/8f67319e3a61460c928c010b02ef0a14` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.036736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] RBAC: Authorizing `identity:get_project(project_id=8f67319e3a61460c928c010b02ef0a14)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.038483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24611ed-d054-4846-8555-1a1fcd031343 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.040597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 92/185] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/projects/8f67319e3a61460c928c010b02ef0a14 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:56.042649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.043132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.043602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.065987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:56.067894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:56.068948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.069915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.070363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.070842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.072284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:56.074334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.076769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.091269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 94/186] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:56.092832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.163119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 93/187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:56.164266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.175516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:56.233529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd6cc-54d3-4681-b828-baff1497042f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.261564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:56.280154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.280856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.281224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.281586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.282405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.284151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5d6d8-d051-4570-bb44-9c59e255ddfa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 95/188] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:56:56 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:56:56.313836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.314230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.314492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.333539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411c866-aa4a-4211-a0e6-6668bb1d66c7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.335811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:56:56.337161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:56:56.407600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.409399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.410144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.410668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.413049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.416034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.420172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 94/189] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:56 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:56.423583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.446775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 96/190] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:56:56.448215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.518767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:56.638070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a491fd-5f95-4a02-bac9-ec0459fc5a08 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.645461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08aed2-5420-4951-ac0e-dff8cd450fa0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:56.689987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:56.707554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.708383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.708823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.709208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.710376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=8f67319e3a61460c928c010b02ef0a14, user.id=b5fd614718af4cdba982df4dd3b59b00) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:56.710871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.713350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.717399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:56.718410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:56.718918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:56.719370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:56.725914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 95/191] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:56 2022] GET /identity/v3/role_assignments?user.id=b5fd614718af4cdba982df4dd3b59b00&scope.project.id=8f67319e3a61460c928c010b02ef0a14&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:56.730519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.745198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:56.747855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:56.752842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 97/192] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:56 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:56.754289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:56.961358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:56.976901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171038f-6b40-4e4f-a06b-bec5dc296696 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.021562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4034-3bdd-4589-aec6-fc898b4a2d5e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.059920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.060191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.060322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.060587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.061364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=0ebcadb74d2c4d319371eb661691d94f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:57.061688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:57.063230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:57.074475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 98/193] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:56 2022] GET /identity/v3/role_assignments?user.id=0ebcadb74d2c4d319371eb661691d94f&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:57.074475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:57.095541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.096603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.097062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.097502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.130245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:57.146911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:57.148646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:56:57.150202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 96/194] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:56:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:57.158160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:57.269280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:57.363704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aee1f-8909-4500-8cf7-c753bf844de4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.376068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ade19-8cb3-429e-bb7c-e44ae9779d46 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.440706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.441477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.441767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.442079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.449530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.450656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.451130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.451650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.458547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:56:57.465005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:56:57.466530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 99/195] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:56:57.467981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:57.515920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:57.607043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:57.609637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:57.674049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76239-e507-4a03-8f75-e0698f26f506 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.709753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:57.750969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.751715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.752078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.752438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.753250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:57.753635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:57.755181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:57.765301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 100/196] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:57.766284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:57.806487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 97/197] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:57.808749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:57.859113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:57.880032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c53f-16d7-4cfb-b3aa-564435dd856a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:57.918724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:57.919524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:57.919915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:57.920300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:57.921168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:57.921583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:57.923264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:57.933799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 101/198] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:57.934603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.003979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105e855-adcb-43fa-94ec-6026ab14e6a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.053046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01adc8-3509-4e47-b63b-488c3e4d9b6e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.078279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.080009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.080524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.081020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.085024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.088100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.091706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 98/199] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:58.095255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.119872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.122791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.123908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.124405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.124810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.127993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.131467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.135924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 102/200] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:57 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:58.138364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.173721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.283401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab3c5-466b-444f-9b8f-dc05c29fc04d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.286812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05392d6-caad-4e97-88e6-1705851c93f2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.350535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.351185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.351477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.351704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.351931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.352686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.355272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.355272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] PATH_INFO: `/v3/users/776f80da694249c29198698dfadbd2f1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.358377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] RBAC: Authorizing `identity:get_user(user_id=776f80da694249c29198698dfadbd2f1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.361272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.370861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 99/201] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/users/776f80da694249c29198698dfadbd2f1 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:58.371474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.461862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.463527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.477086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.519364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.541340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693edd3-b87d-423f-b12f-24621c4933b0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.582578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 103/202] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:58.584358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.595716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.596368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.596656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.596942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.597746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=246e437a249b4096a1ca1ae74e2071cc) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:58.598065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.599986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.608172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 100/203] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/role_assignments?user.id=246e437a249b4096a1ca1ae74e2071cc&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:58.608929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.706796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce522-97b5-474c-9ff9-67d25f15c4f3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.720775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.748105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043f02-580b-4980-a139-dc346ac93ecb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:58.748913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.750042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.750570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.751080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.846799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:58.849003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:58.850760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:58.854745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:58.856534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.858276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:58.862667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 101/204] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:58.870677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:58.896880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:58.911392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:58.913545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:59.037129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bb201-b6a7-4799-9801-64d33cc23f60 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:59.070325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 104/205] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:56:59.079590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:59.099018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:59.124763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:59.125424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:59.125698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:59.125986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:59.126831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=246e437a249b4096a1ca1ae74e2071cc) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:59.127153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:59.128629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:59.141965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 102/206] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:58 2022] GET /identity/v3/role_assignments?user.id=246e437a249b4096a1ca1ae74e2071cc&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=a459998da52847ad9ba273f6520dabca => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:56:59.277257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2089-365b-4783-a273-aa0b73265903 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:59.345886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:59.346970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:59.347417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:59.347873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:59.350199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:59.352935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f865f-d99d-4cdc-af26-e055920ea527 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:59.356858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 105/207] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:56:59 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:56:59.367273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:56:59.550966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:56:59.584245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da65c1-5749-4ec0-b321-1326ec461eb1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:56:59.647702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:56:59.648381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:56:59.648691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:56:59.648972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:56:59.649776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae, user.id=776f80da694249c29198698dfadbd2f1) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:56:59.650120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:56:59.653503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5c0d0-35a4-4aa4-885f-49dfa470924b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:56:59.665774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 103/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:56:59 2022] GET /identity/v3/role_assignments?user.id=776f80da694249c29198698dfadbd2f1&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:00.201022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c75c-0fdc-4d3e-87d4-11ce6aaf7fb6 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.201540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c75c-0fdc-4d3e-87d4-11ce6aaf7fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.201613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c75c-0fdc-4d3e-87d4-11ce6aaf7fb6 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.203951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 106/209] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:00.212620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612138-6f57-4858-9c74-116869545ac0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.213732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612138-6f57-4858-9c74-116869545ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.215129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612138-6f57-4858-9c74-116869545ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.239224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-74612138-6f57-4858-9c74-116869545ac0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:00.241107 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-74612138-6f57-4858-9c74-116869545ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:00.362289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 104/210] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:00.409418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c75c-0fdc-4d3e-87d4-11ce6aaf7fb6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:00.426491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95530-499f-4f68-bfa6-d3a4bbcb91e8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.427427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95530-499f-4f68-bfa6-d3a4bbcb91e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.428170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95530-499f-4f68-bfa6-d3a4bbcb91e8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.430552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 105/211] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:00.440945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.441848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.442670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.472459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:00.475074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:00.591503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:00.626123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 106/212] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:00.643680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c75c-0fdc-4d3e-87d4-11ce6aaf7fb6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:00.666510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:00.683492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:00.723485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:00.725155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.726288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.727072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.752511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:00.766898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:00.768866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:00.770702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:00.775622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 107/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:00.784600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:00.842425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ccf5-24ec-4ff3-8834-694684ac9ff9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:00.899015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464a821-720d-4036-8263-93009b8409cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:00.899680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464a821-720d-4036-8263-93009b8409cb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:00.899964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464a821-720d-4036-8263-93009b8409cb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:00.900245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464a821-720d-4036-8263-93009b8409cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:00.901756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464a821-720d-4036-8263-93009b8409cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:00.903786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464a821-720d-4036-8263-93009b8409cb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:00.905790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 107/214] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:00.914878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464a821-720d-4036-8263-93009b8409cb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:01.005651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fde680-437b-4505-a6db-0ef61008382a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.057436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.059519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.060018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.060515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.061492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:01.062182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:01.064501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:01.073465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.077868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.080563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 108/215] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:01.090505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:01.130153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464a821-720d-4036-8263-93009b8409cb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.172161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.172906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.173258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.173607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.174571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:01.176128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3bf2-2c06-4e21-be53-0bef488e29a3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:01.211281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 108/216] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:00 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:57:01.218545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee11-6c14-4be2-a216-860d334ece9e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.218545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee11-6c14-4be2-a216-860d334ece9e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.218545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee11-6c14-4be2-a216-860d334ece9e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.218545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 109/217] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:01.221678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.222052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.222416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.243075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:01.244311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:01.267636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58f50-56f1-4caa-9c94-055e2978692a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.337206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 110/218] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:01.345108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.346964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.347935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.348791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] PATH_INFO: `/v3/users/a3589d396b4248aabf94d98f919c709f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.361051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:01.385712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] RBAC: Authorizing `identity:get_user(user_id=a3589d396b4248aabf94d98f919c709f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:01.389721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:01.393954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 109/219] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:01 2022] GET /identity/v3/users/a3589d396b4248aabf94d98f919c709f => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:01.403241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:01.446879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.515408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132348ba-5ea6-472a-ac46-ad5fd70b8cbf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.523059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.565259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.566259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.566757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.567183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.585143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:01.594910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba40b25-8640-4f84-8425-b37d8fe6f425 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-12fef7d3-4cba-429b-abbe-4c7a9dffb4ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:01.596723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:01.597847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:01.598872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:01.602535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 111/220] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:01.604617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df71b-8ee1-40d5-9ae1-031ea9f8fbfe None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.604919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df71b-8ee1-40d5-9ae1-031ea9f8fbfe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.605201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df71b-8ee1-40d5-9ae1-031ea9f8fbfe None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.606781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 112/221] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:01.609315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614df71b-8ee1-40d5-9ae1-031ea9f8fbfe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:01.653546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.654185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.654486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.654767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.786594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:01.789140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:01.813557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614df71b-8ee1-40d5-9ae1-031ea9f8fbfe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:01.860687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.896690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:01.899032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.899778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.900503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.903079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:01.903894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:01.908243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e06467-0bc6-45f1-88f7-d007e932bc38 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:01.910359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:01.934396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 113/222] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:01.938815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:01.939587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:01.940307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:01.980316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:01.983891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:02.000423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 110/223] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:02.002112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.139533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 114/224] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:02.148316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.204612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626a40-c2e0-4fd7-bf36-0f02ba58b1e5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.272956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.274023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.274462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.274989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.277781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:02.280789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:02.284128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 111/225] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:02.285092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.339146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:02.384772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ab97e-51b2-4b8b-824c-7fdd947bb66e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.402094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:02.426237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.427231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.427756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.428175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.429543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:02.431213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:02.433108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 115/226] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:02.434077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.486955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2213-fd78-414a-81c5-48376eb690ae None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.550748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16e692-acfd-449a-bac7-2e5a1d31b35b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.551126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.552321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.552931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.553399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.573904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:02.584124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:02.585250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:02.586202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:02.586836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 112/227] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:02.587914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.602757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.603436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.603722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.604003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.605244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:02.606756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:02.608531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 116/228] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:02.609437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.686064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:02.728595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:02.751001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70bee-3ed1-42c1-bb51-f47523ef2a0f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.786431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2f69f-8eb8-4845-8da0-ff3851037207 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:02.794048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.795100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.795593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.796094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.797099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=a3589d396b4248aabf94d98f919c709f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:02.797616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:02.799336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:02.806007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 113/229] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/role_assignments?user.id=a3589d396b4248aabf94d98f919c709f&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:02.814378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:02.864168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:02.865591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:02.866219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:02.866775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:02.868392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:02.868734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:02.876099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:02.899109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 117/230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:02.906755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:03.034407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324298-5ff0-46b3-b47b-cc40f5f17820 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:03.058831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:03.089558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:03.090238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.090622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.091027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.093346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:03.096017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:03.098232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 118/231] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:02 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:03.105140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b4c8-7e81-4c60-aef8-06cd5629ebb8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:03.107008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:03.188414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:03.189134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.189426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.189713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/246e437a249b4096a1ca1ae74e2071cc/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.194609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, user_id=246e437a249b4096a1ca1ae74e2071cc, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:03.196116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:03.229072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 114/232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:02 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/246e437a249b4096a1ca1ae74e2071cc/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:03.229266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977a29-40ea-4903-b322-fefaa1fb2f19 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:03.272426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:03.273112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.273400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.273687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.275066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:03.276603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912e680-3eec-4471-996c-13d92291ab32 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:03.278761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 119/233] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:03 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:03.284890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:03.300756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:03.429134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc803-e84e-4390-b11a-1669f5fbe5e1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:03.482058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:03.482881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.483169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.483458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/246e437a249b4096a1ca1ae74e2071cc/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.485849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, user_id=246e437a249b4096a1ca1ae74e2071cc, role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:03.487432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725442f-92d9-4fd0-a937-dca1ad7f5a96 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:03.505167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 115/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:03 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/246e437a249b4096a1ca1ae74e2071cc/roles/a459998da52847ad9ba273f6520dabca => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:03.642144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f173e-1180-4ec0-afbe-2c2cf4c5afa5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.642888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f173e-1180-4ec0-afbe-2c2cf4c5afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.642888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f173e-1180-4ec0-afbe-2c2cf4c5afa5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.644404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 120/235] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:03.649969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.650275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.650566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.676065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:03.677302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:03.751229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1cb1-2082-4941-a722-94c60d1bbea5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.751741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1cb1-2082-4941-a722-94c60d1bbea5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.752255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1cb1-2082-4941-a722-94c60d1bbea5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.754994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 121/236] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:03.762752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:03.763047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:03.763627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:03.773680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:03.780717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 116/237] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:03.800515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:03.801782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:03.809422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:03.874325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:03.930435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 122/238] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:03.965752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:04.007267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98737d27-4b0f-42ac-8f23-2812d315e590 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:04.078284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:04.079005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:04.079293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:04.079578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:04.103102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:04.109391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:04.110315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:04.111442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:04.120120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 117/239] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:04.122999 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:04.226968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29099f-6850-4b90-b692-fa315b511d30 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:04.232042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:04.313183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b742bde-b7db-4205-9e38-72c412640528 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:04.372547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:04.373711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:04.374217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:04.374763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:04.377184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:04.379635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:04.381887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 123/240] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:04.387855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:04.388072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:04.388936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:04.389438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:04.389939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:04.391326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:04.391893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:04.394564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:04.418849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 118/241] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:04.425694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:04.536454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:04.609257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e889ea-99b0-4de8-b3ae-6d3bcaef8c47 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:04.635482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:04.653446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:04.654532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:04.655020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:04.655533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] PATH_INFO: `/v3/users/1280d94625844466af91649fa60bb44a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:04.671238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] RBAC: Authorizing `identity:get_user(user_id=1280d94625844466af91649fa60bb44a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:04.673070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:04.675110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 119/242] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:04 2022] GET /identity/v3/users/1280d94625844466af91649fa60bb44a => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:04.680945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:04.732190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29e4ab-afdc-4bfe-9fad-75904dceaf3a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:04.865605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:04.866760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:04.867280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:04.867786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:04.874490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:04.874490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:04.945488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 124/243] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:04 2022] POST /identity/v3/users => generated 293 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:04.967256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792741e0-baf9-47eb-a2c7-1dbec3b05f0c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:05.037419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:05.038090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:05.038382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:05.038697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:05.191073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:05.234221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:05.236888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:05.392468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 120/244] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 11:57:05.408358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:05.664324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:05.673336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492753ec-2ae7-4a53-8554-2100004cef25 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:05.751321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:05.752423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:05.752869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:05.753338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:05.755478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:05.758027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a426311-e6aa-4687-9a54-34bf01dfe612 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:05.762124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 125/245] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:05 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:05.771512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:05.970647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:06.013749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fcd7d-3eee-4b08-ab87-4bd871b4a4c2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:06.048637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c5e5-3a95-4458-b7a0-515961bf3351 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.049033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c5e5-3a95-4458-b7a0-515961bf3351 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.049222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6c5e5-3a95-4458-b7a0-515961bf3351 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.050911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 126/246] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:06.058562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf90a-ea40-444a-94be-0a0fd5f61177 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.058892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf90a-ea40-444a-94be-0a0fd5f61177 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.059129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf90a-ea40-444a-94be-0a0fd5f61177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.097405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:06.098063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.098355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.098673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.099495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=1280d94625844466af91649fa60bb44a) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:06.099815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:06.101369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926394c3-4d8d-4a1f-9fe1-61fa982aa7cd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:06.105417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5abcf90a-ea40-444a-94be-0a0fd5f61177 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:06.107533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5abcf90a-ea40-444a-94be-0a0fd5f61177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:06.109487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 121/247] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:05 2022] GET /identity/v3/role_assignments?user.id=1280d94625844466af91649fa60bb44a&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:06.111141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57984-6585-47d0-b969-5e17baa38cbf None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.111620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57984-6585-47d0-b969-5e17baa38cbf None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.112077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c57984-6585-47d0-b969-5e17baa38cbf None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.113596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 122/248] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:06.121015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e414-37f5-459d-a498-24e300f37629 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.121586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e414-37f5-459d-a498-24e300f37629 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.122044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e414-37f5-459d-a498-24e300f37629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.144173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a347e414-37f5-459d-a498-24e300f37629 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:06.145925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a347e414-37f5-459d-a498-24e300f37629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:06.265992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 123/249] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:06.302922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e414-37f5-459d-a498-24e300f37629 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:06.346768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 127/250] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:06.349149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c4c4-1d92-45b1-85c0-93a874a03a66 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.349651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c4c4-1d92-45b1-85c0-93a874a03a66 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.350151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c4c4-1d92-45b1-85c0-93a874a03a66 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.353105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 128/251] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:06.362957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.363448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.363941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.413590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:06.415744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:06.503280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:06.544010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e414-37f5-459d-a498-24e300f37629 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:06.585881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:06.587241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.587767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.587972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 129/252] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:06.588395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.589865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:06.601386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:06.607321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:06.608415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:06.609373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:06.611872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 124/253] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:06.621109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:06.630092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:06.709861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97921b9c-9898-423f-99ab-0340173a7ce4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:06.749531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:06.750049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4a58-4438-4410-be91-763005f5867c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:06.750485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.751079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.751483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.764790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:06.770246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:06.771208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:06.771971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 130/254] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:06.772625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:06.863958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:06.864527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.864819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.865101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:06.865841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:06.866154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:06.867625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:06.869309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:06.883815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:06.893077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 125/255] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:06.894001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:06.903839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e780ee-09cf-49dc-9ac7-a44c2c846cc5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:06.977345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:06.978015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:06.978300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:06.978617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.000964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:07.007174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:07.008089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:07.008851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:07.011635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 131/256] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:07.012706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:07.152134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1a254-715b-42f2-a6ef-cfccd487259e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:07.178350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37ded-34bd-4d8c-9960-9099a8f2abaf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:07.214588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:07.215265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:07.215553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:07.215834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.218225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:07.219736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:07.221562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 132/257] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:07.224142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:07.250014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:07.250681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:07.250973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:07.251259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.251995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:07.252312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:07.253736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:07.263656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:07.270141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 126/258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:07.272376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:07.382764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:07.437790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28087a5-607d-4ab8-b987-1aae8b5b4c73 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:07.476527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814fd8-5a00-42d2-b4f5-7702e7c7fcbe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:07.514986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:07.515628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:07.515911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:07.516188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.516921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:07.517231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:07.518652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:07.536496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 133/259] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:07.537384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:07.560543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:07.562315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:07.563002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:07.563868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.721729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:07.725467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:07.728871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:07.784303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3e380-d16f-41e2-9358-70bb618e22b1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:07.874121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:07.874845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:07.875182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:07.875485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] PATH_INFO: `/v3/users/246e437a249b4096a1ca1ae74e2071cc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:07.876704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] RBAC: Authorizing `identity:get_user(user_id=246e437a249b4096a1ca1ae74e2071cc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:07.878168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:07.880563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 134/260] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/users/246e437a249b4096a1ca1ae74e2071cc => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:07.881380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:07.891975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:07.992619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 127/261] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:07.993501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.110822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e38c5-2450-4d83-a745-9036fe4778c5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.193131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.193851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.194182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.194485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] PATH_INFO: `/v3/users/a3589d396b4248aabf94d98f919c709f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.196253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] RBAC: Authorizing `identity:get_user(user_id=a3589d396b4248aabf94d98f919c709f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.197870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.200985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 135/262] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/users/a3589d396b4248aabf94d98f919c709f => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:08.201884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae62c6-7be8-457b-b327-052997825175 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.202003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.223226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:08.280329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.280984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.281272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.281556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.336444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102cfd-b9e3-4f03-85fd-d980d90c1b29 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.354979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:08.379787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.380459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.380747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.381027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.382331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.385451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.385679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 136/263] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:08 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:08.388171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.434990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.436815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dc74-1934-47b7-b5fd-5cbc5aac6a2e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.530030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:08.556519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe7dc-75e2-4692-ba2a-f7f81a92eb55 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 128/264] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d5b70-88d2-4975-aa90-9c6092285808 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d5b70-88d2-4975-aa90-9c6092285808 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d5b70-88d2-4975-aa90-9c6092285808 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 129/265] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:08.578133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d5b70-88d2-4975-aa90-9c6092285808 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.606073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.607170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.607674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.608170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.609765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.611604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.614127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 137/266] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:08 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:08.615211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.650764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:08.708510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d5b70-88d2-4975-aa90-9c6092285808 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.753300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.753935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.754216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.754519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.755361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=246e437a249b4096a1ca1ae74e2071cc) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:08.755588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844db53-6f76-4f81-9043-ec7f3f19134d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:08.755685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.757174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da6179-08f1-49f7-b740-c8fb0422d6ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.770476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 130/267] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:08 2022] GET /identity/v3/role_assignments?user.id=246e437a249b4096a1ca1ae74e2071cc&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:08.770476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3833d-47b7-42ed-9e34-12c3d01a9da5 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.770476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3833d-47b7-42ed-9e34-12c3d01a9da5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.770476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3833d-47b7-42ed-9e34-12c3d01a9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.788553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-85f3833d-47b7-42ed-9e34-12c3d01a9da5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:08.790801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-85f3833d-47b7-42ed-9e34-12c3d01a9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:08.820230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:08.821705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.822209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.823023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.826575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:08.831025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:08.836063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 138/268] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:08 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:08.838098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:08.884317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:08.888914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 131/269] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:08.892409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7090ed-7479-4f7c-b936-4a509d2f4baa None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:08.893321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7090ed-7479-4f7c-b936-4a509d2f4baa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:08.893830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7090ed-7479-4f7c-b936-4a509d2f4baa None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:08.898842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 132/270] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:08.900750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7090ed-7479-4f7c-b936-4a509d2f4baa None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.010245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.014910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb039-bdcc-4183-891b-c08f4052c2c2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.068741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.069441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.069718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.070022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/a3589d396b4248aabf94d98f919c709f/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.072205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, user_id=a3589d396b4248aabf94d98f919c709f, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:09.074163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22329ce-47e1-497c-99ac-286763183d55 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:09.078497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7090ed-7479-4f7c-b936-4a509d2f4baa None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.088258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 139/271] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:08 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/a3589d396b4248aabf94d98f919c709f/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:09.090109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a2e0-ec6a-4721-b227-5d8908276ea8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.090518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a2e0-ec6a-4721-b227-5d8908276ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.090802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a2e0-ec6a-4721-b227-5d8908276ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.110712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f077a2e0-ec6a-4721-b227-5d8908276ea8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:09.111968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f077a2e0-ec6a-4721-b227-5d8908276ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:09.137724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.138883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.139289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.139795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.141381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=246e437a249b4096a1ca1ae74e2071cc) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:09.141957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:09.144663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798e7f-93c4-488c-80e2-b2c79310adef None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:09.166478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 133/272] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:08 2022] GET /identity/v3/role_assignments?user.id=246e437a249b4096a1ca1ae74e2071cc&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=a459998da52847ad9ba273f6520dabca => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:09.166478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25871cc-a700-40e0-83fe-b1d6023053cc None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.166478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25871cc-a700-40e0-83fe-b1d6023053cc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.166478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25871cc-a700-40e0-83fe-b1d6023053cc None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.166478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 134/273] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:09.171443 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25871cc-a700-40e0-83fe-b1d6023053cc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.203913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 140/274] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:09.205919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.206529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.207141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.227271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:09.228652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:09.243179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.345363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 141/275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:09.346181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.359449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25871cc-a700-40e0-83fe-b1d6023053cc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.391459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.421883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.422623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.422922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.423210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.440807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:09.449077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:09.451504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 135/276] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:09.459451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.525351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc767c-754c-42ee-b5ec-25c5793c065e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.592115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.592813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.593067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.593345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.603014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.609180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:09.615633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:09.616793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:09.617928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:09.619758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d48a25-5152-4587-955d-e71c5ab8b005 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.620931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 142/277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:09.620931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.681560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.682709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.683219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.683715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.685629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:09.688369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:09.691632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 136/278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:09.696185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.754373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.765003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1076-a6c8-47e1-b64e-d7af6f99dab4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.815651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9dff-7382-4dd2-a0fe-8db77075183d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:09.826101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.827142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.827623 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.828101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.829274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:09.829802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:09.832440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:09.845765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 143/279] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:09.846655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.862146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:09.862706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:09.862990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:09.863280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:09.863993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:09.864300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:09.865711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:09.874351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 137/280] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:09.875227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:09.931869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:09.995778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a305f-2486-425e-9910-34effce5bd00 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.009024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb8ffc-6bc6-498a-a489-86c1949b24ea None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.022615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:10.035823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.036471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.036756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.037101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.037707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.039186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.060763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 144/281] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:09 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:10.070643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:10.085062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.086077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.086596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.087061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] PATH_INFO: `/v3/users/548f2061e5fb4c6387fc65472c9d023a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.112741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] RBAC: Authorizing `identity:get_user(user_id=548f2061e5fb4c6387fc65472c9d023a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.115534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.123061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 138/282] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:09 2022] GET /identity/v3/users/548f2061e5fb4c6387fc65472c9d023a => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:10.129030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:10.255906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe92a-669d-4c53-a521-18c035cc2871 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.282527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:10.320677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.321545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.322005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.322538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] PATH_INFO: `/v3/users/1280d94625844466af91649fa60bb44a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.325120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1280d94625844466af91649fa60bb44a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.329137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.331802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 145/283] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:10 2022] GET /identity/v3/users/1280d94625844466af91649fa60bb44a => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:10.336409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de109c-b743-4690-9188-66c9ab08c57b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.338529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:10.381813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.382880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.383390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.383881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.384922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, user.id=548f2061e5fb4c6387fc65472c9d023a, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:10.385560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.388256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.397367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 139/284] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 3 11:57:10 2022] GET /identity/v3/role_assignments?user.id=548f2061e5fb4c6387fc65472c9d023a&scope.system=all&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:10.513500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877de55-a79d-4a9c-9e02-3a99d2fd35a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.560725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.561402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.561684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.561965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.563245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.564894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd68867-904d-4270-87e4-a62637f03076 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.567109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 146/285] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:10 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:10.573410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:10.624670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:10.733860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e073a-c045-4cff-b6fe-8d3ebc1f008c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:10.789246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:10.790341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:10.790961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:10.791459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/1280d94625844466af91649fa60bb44a/roles/81e19493c60b4327ada6a0ab081e9b25` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:10.800288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, user_id=1280d94625844466af91649fa60bb44a, role_id=81e19493c60b4327ada6a0ab081e9b25)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:10.802344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147f39-299d-4726-b042-c39f23d0860d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:10.825801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 140/286] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:10 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/users/1280d94625844466af91649fa60bb44a/roles/81e19493c60b4327ada6a0ab081e9b25 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 11:57:11.735797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be556f-8ed4-4422-92e0-2ec31594991d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:11.736292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be556f-8ed4-4422-92e0-2ec31594991d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:11.736680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be556f-8ed4-4422-92e0-2ec31594991d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:11.739445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 147/287] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:11.747873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:11.748814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:11.749299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:11.779547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:11.781132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:11.874378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 141/288] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:11.942866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be556f-8ed4-4422-92e0-2ec31594991d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:12.027170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:12.099720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be556f-8ed4-4422-92e0-2ec31594991d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:12.149592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:12.150267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:12.150583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:12.150865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:12.168580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:12.174122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:12.175005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:12.176272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 148/289] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:12.185148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:12.218426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:12.319370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0af1-31ec-4a5a-adcf-92c15b73d11c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:12.369435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:12.370691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:12.371019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:12.371336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:12.372099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:12.372435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:12.373974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:12.392434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 142/290] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:12.398733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:12.552713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3d171-49a7-40a3-8ee9-e9b20123f566 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:12.571074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:12.606103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:12.606802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:12.607087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:12.607368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] PATH_INFO: `/v3/users/a3589d396b4248aabf94d98f919c709f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:12.608599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] RBAC: Authorizing `identity:get_user(user_id=a3589d396b4248aabf94d98f919c709f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:12.610064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:12.612059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 149/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:12 2022] GET /identity/v3/users/a3589d396b4248aabf94d98f919c709f => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:12.618473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:12.761876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:12.789703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c127-d1f1-45d1-9be9-3bf290191a81 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:12.837633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:12.838264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:12.838581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:12.839486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:12.954550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:12.956101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:13.071693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:13.098377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 143/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:13.104086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:13.275670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf580fb-3be1-46bf-bc40-9daa9027c287 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:13.327018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:13.327782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.328075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.328358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.329658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:13.331217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702356-27c8-453d-b3a9-84f37d85ed1c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:13.337488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 150/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:13 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:13.339667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:13.396166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c100a-48f7-4608-9eb1-12c2c5b3af28 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.396457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c100a-48f7-4608-9eb1-12c2c5b3af28 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.396780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c100a-48f7-4608-9eb1-12c2c5b3af28 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.398565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 151/294] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:13.404705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e707-6284-4986-a925-ee149890077f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.405010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e707-6284-4986-a925-ee149890077f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.405275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e707-6284-4986-a925-ee149890077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.437937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-46e1e707-6284-4986-a925-ee149890077f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:13.440530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-46e1e707-6284-4986-a925-ee149890077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:13.488884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9f2f-ca86-4b13-8fb4-98fd38cab404 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:13.513924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:13.534464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:13.534464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.534464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.534464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.535033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=a3589d396b4248aabf94d98f919c709f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:13.535241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 152/295] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:13.535350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:13.536807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c926-fda9-4b1c-abd6-516b6749b46b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:13.537192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37898-2c55-464d-b4f0-77a7d7a5e031 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.537682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37898-2c55-464d-b4f0-77a7d7a5e031 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.538166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e37898-2c55-464d-b4f0-77a7d7a5e031 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.540013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 153/296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:13.544203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 144/297] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:13 2022] GET /identity/v3/role_assignments?user.id=a3589d396b4248aabf94d98f919c709f&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:13.550822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e7eb-3ba0-460d-8a76-bb419125864c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.551386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e7eb-3ba0-460d-8a76-bb419125864c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.551865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e7eb-3ba0-460d-8a76-bb419125864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.568529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db257dc3-731a-444e-953a-a99ea016ad14 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.569276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db257dc3-731a-444e-953a-a99ea016ad14 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.569767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db257dc3-731a-444e-953a-a99ea016ad14 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.579134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 145/298] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:13.580743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db257dc3-731a-444e-953a-a99ea016ad14 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:13.582202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bb49e7eb-3ba0-460d-8a76-bb419125864c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:13.583705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bb49e7eb-3ba0-460d-8a76-bb419125864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:13.664770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:13.707470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 154/299] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:13.708375 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563b8ec-dd5a-41e5-af69-d625feabdbd3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.708678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563b8ec-dd5a-41e5-af69-d625feabdbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.708960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563b8ec-dd5a-41e5-af69-d625feabdbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.728790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b563b8ec-dd5a-41e5-af69-d625feabdbd3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:13.730754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b563b8ec-dd5a-41e5-af69-d625feabdbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:13.738795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db257dc3-731a-444e-953a-a99ea016ad14 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:13.784897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:13.786068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.786591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.787115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.789289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:13.793018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:13.796308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 146/300] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:13.797959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:13.809930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 155/301] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:13.811255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debc0a-e5ab-41b6-aebc-c367f0a1618f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.811549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debc0a-e5ab-41b6-aebc-c367f0a1618f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.811830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debc0a-e5ab-41b6-aebc-c367f0a1618f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.813104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 156/302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:13.813794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debc0a-e5ab-41b6-aebc-c367f0a1618f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:13.866071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:13.939307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debc0a-e5ab-41b6-aebc-c367f0a1618f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:13.946618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6eeeb-503c-4a38-b101-6e0e3abf74a6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:13.961159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:13.977324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:13.977972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.978259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.978569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] PATH_INFO: `/v3/groups` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:13.979285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:13.981248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b2626-2ecb-4792-bc79-7cd6e257f7ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:13.992623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:13.993734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:13.994304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:13.994945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.006698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 157/303] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 3 11:57:13 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:14.006698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.006698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.006698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.018714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:14.025153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:14.026984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:14.030667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:14.031658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:14.032498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:14.038640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 147/304] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:14.039853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.143142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 158/305] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:14.144250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.201823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.203251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2601-cc00-4fbb-aef3-baefc19122c2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.258771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.259430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.259724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.260016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.280665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:14.293518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:14.294675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:14.295760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 148/306] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:14.297574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.310694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec98b-8c52-4813-9a83-b2fd84ad1c1e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.342417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.371396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.372451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.373199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.373454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.374786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:14.375336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:14.377733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:14.393045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 159/307] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:14.395078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.453336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f84bb9-85b2-4a19-9c6d-e19fe2c6e055 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.499622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.500394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.500744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.501086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.513810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:14.519488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:14.520375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 149/308] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:14.521578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.541874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.553932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b422-db8f-46fb-8b21-cb671124f3de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.593745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.594400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.594733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.595459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.595735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:14.596170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:14.597501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:14.611634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 160/309] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:14.611634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.670108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.682078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab9a-bb77-4471-b18c-b89e3adb76f9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.732435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.733022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.733308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.733595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] PATH_INFO: `/v3/users/a7575b884f5c42309bce60b9624144bf` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.745322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b550-5b89-4fb5-aa42-cd8562a9a740 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.750382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] RBAC: Authorizing `identity:get_user(user_id=a7575b884f5c42309bce60b9624144bf)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:14.753162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:14.762472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 150/310] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/users/a7575b884f5c42309bce60b9624144bf => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:14.762472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.793322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.794074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.794354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.794660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.795391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:14.795700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:14.797121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:14.807099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 161/311] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:14.808528 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.833664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.896804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf295d-a3a8-4be2-bf29-48b8802f5b39 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:14.936531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:14.937381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:14.937674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:14.937964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] PATH_INFO: `/v3/users/548f2061e5fb4c6387fc65472c9d023a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:14.940882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] RBAC: Authorizing `identity:get_user(user_id=548f2061e5fb4c6387fc65472c9d023a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:14.942298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:14.944026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 151/312] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/users/548f2061e5fb4c6387fc65472c9d023a => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:14.944827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:14.970982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:14.971853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566bae2-c154-42f3-b175-d4dd02415ee3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:15.019479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:15.020690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:15.021204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:15.021702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:15.023294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, user.id=a7575b884f5c42309bce60b9624144bf, scope.system=all) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:15.023863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:15.026818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:15.046486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 162/313] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/role_assignments?user.id=a7575b884f5c42309bce60b9624144bf&scope.system=all&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:15.046486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:15.100236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f48810-1a0c-4590-8aff-d706012c119e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:15.147075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:15.147965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:15.148341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:15.148690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] PATH_INFO: `/v3/users/1280d94625844466af91649fa60bb44a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:15.150186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] RBAC: Authorizing `identity:get_user(user_id=1280d94625844466af91649fa60bb44a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:15.152071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:15.154487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 152/314] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:14 2022] GET /identity/v3/users/1280d94625844466af91649fa60bb44a => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:15.160619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:15.167880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:15.206284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48906-157a-4646-8c97-54fc1b29a803 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:15.277996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:15.278714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:15.279335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:15.279960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] PATH_INFO: `/v3/system/users/548f2061e5fb4c6387fc65472c9d023a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:15.284255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=548f2061e5fb4c6387fc65472c9d023a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:15.285915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:15.306496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 163/315] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 3 11:57:15 2022] PUT /identity/v3/system/users/548f2061e5fb4c6387fc65472c9d023a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:15.324951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:15.346284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa384c-25b1-49f9-8e71-9900180f0571 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:15.406407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:15.407503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:15.408009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:15.408501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:15.541564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:15.543731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:15.673063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:15.700288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 153/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 11:57:15.708131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:15.830649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598939a-295b-4a11-9625-1c18bcb1511d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:15.869476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:15.870175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:15.870484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:15.870779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:15.872040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:15.873511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92476298-fbc3-47f6-a8a1-61dea6563943 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:15.875625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 164/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:15 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:15.885139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:16.081544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a24795-c2ee-4d51-9652-920ba34f7034 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:16.139374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:16.139881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:16.140028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:16.146477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:16.146477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, scope.project.id=2f8e28c0f46844e18ce1143582f5c068, user.id=1280d94625844466af91649fa60bb44a) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:16.146477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:16.146477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270f13c-943a-4816-9cfd-f64337aeaaa9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:16.150533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 154/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:15 2022] GET /identity/v3/role_assignments?user.id=1280d94625844466af91649fa60bb44a&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:16.274133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf55f-0505-4902-9f97-0a56e773b1f3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:16.275732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf55f-0505-4902-9f97-0a56e773b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:16.276577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf55f-0505-4902-9f97-0a56e773b1f3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:16.279879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 165/319] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:16.288540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:16.289436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:16.289436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:16.309754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:16.311335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:16.399534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:16.424863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 155/320] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:16.450519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf55f-0505-4902-9f97-0a56e773b1f3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:16.467569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:16.603938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf55f-0505-4902-9f97-0a56e773b1f3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:16.642620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:16.643320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:16.643610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:16.643888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:16.645027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:16.646631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb59ddd-c921-4a5f-8b0b-41cae1a95b00 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:16.652849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 166/321] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:16.653964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:16.755231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d72e15-92d8-451d-aadb-427b52ca7507 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:16.788856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:16.789500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:16.789788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:16.790069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] PATH_INFO: `/v3/groups` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:16.790776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:16.792799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4b08-4fc3-4588-bc81-4c0e0aaa5836 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:16.810629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 156/322] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 3 11:57:16 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:57:17.538733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc4a0-9e8f-407f-b172-47619881f018 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:17.539247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc4a0-9e8f-407f-b172-47619881f018 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:17.539319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc4a0-9e8f-407f-b172-47619881f018 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:17.540955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 167/323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:17.546616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:17.547087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:17.547245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:17.577834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:17.579100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:17.623669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf08e1-47ad-4a5c-bfe9-94361b131889 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:17.624089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf08e1-47ad-4a5c-bfe9-94361b131889 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:17.624399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf08e1-47ad-4a5c-bfe9-94361b131889 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:17.626397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 168/324] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:17.631894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:17.632072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:17.632253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:17.632531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:17.655616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:17.656827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:17.673619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 157/325] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:17.699939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:17.747832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 169/326] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 11:57:17.783712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:17.799295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:17.832213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcac3c-5c06-47b3-9b21-340c678f0265 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:17.874881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:17.875556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:17.875847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:17.876126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:17.891436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:17.897285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:17.898214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:17.899016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 158/327] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:17.904680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:17.965201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:17.975518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b755e-ac6f-405d-beb3-a8251ff9ee97 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.063134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80bed8-0d7c-418a-a77e-c159a101c583 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.104893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.105642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.105993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.106371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.107265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:18.107746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:18.109374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:18.119478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 159/328] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:18.120497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.121612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.122028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.126564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.127986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:18.162012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:18.177285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:18.178228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:18.179029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:18.179606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 170/329] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:18.201747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:18.346081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:18.374861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:18.389381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e767-f505-4690-95eb-26248fdf5c09 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.446685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1c3b8-4085-46c9-a472-52b25d2cdebe None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.483810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.484496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.484785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.485067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] PATH_INFO: `/v3/users/548f2061e5fb4c6387fc65472c9d023a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.487460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=548f2061e5fb4c6387fc65472c9d023a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:18.488866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:18.498510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 160/330] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:18 2022] GET /identity/v3/users/548f2061e5fb4c6387fc65472c9d023a => generated 293 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:18.503013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:18.533946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.534954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.535321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.535602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.536351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:18.536666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:18.538091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:18.558222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 171/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:18.563639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:18.789609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5ca3-dd67-479a-a438-f02ca6bab8b7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.847213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d53f-a744-4900-915f-65992573ae68 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:18.866951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.867613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.867915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.868204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.869031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] RBAC: Adding query filter params (role.id=271aea4edf604c2b829a1a2a8b83289e, user.id=548f2061e5fb4c6387fc65472c9d023a, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:18.869355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:18.870922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:18.892511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 161/332] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 3 11:57:18 2022] GET /identity/v3/role_assignments?user.id=548f2061e5fb4c6387fc65472c9d023a&scope.system=all&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 510 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:18.926041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:18.941225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:18.941915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:18.942214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:18.942521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] PATH_INFO: `/v3/users/a7575b884f5c42309bce60b9624144bf` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:18.947475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] RBAC: Authorizing `identity:get_user(user_id=a7575b884f5c42309bce60b9624144bf)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:18.949561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b445050-9e16-43a3-a8b2-60f3c89f1edb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:18.952250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 172/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:18 2022] GET /identity/v3/users/a7575b884f5c42309bce60b9624144bf => generated 293 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:18.959689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:18.987771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:19.118943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681dfe-dde9-4504-885e-6a58b71d21a5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:19.170239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:19.170993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:19.171285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:19.171571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] PATH_INFO: `/v3/system/users/a7575b884f5c42309bce60b9624144bf/roles/81e19493c60b4327ada6a0ab081e9b25` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:19.173113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a7575b884f5c42309bce60b9624144bf, role_id=81e19493c60b4327ada6a0ab081e9b25)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:19.174560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d92e-b565-4e07-bdef-a9212ce19ad3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:19.187687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 162/334] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 3 11:57:18 2022] PUT /identity/v3/system/users/a7575b884f5c42309bce60b9624144bf/roles/81e19493c60b4327ada6a0ab081e9b25 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:20.184775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733411-3057-48b6-ba2b-afd2a397a7fd None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.185538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733411-3057-48b6-ba2b-afd2a397a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.185538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733411-3057-48b6-ba2b-afd2a397a7fd None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.186901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 173/335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:20.192909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.193677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.193677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.220581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:20.221845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:20.322361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 163/336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:20.359081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733411-3057-48b6-ba2b-afd2a397a7fd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:20.560358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733411-3057-48b6-ba2b-afd2a397a7fd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:20.608241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:20.609315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.609800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.610282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.637247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7a4b00bd-b927-4745-a6d2-3fe05bf1ff9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:20.648523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:20.649612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:20.650518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:20.659393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 174/337] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:20.667716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:20.694758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:20.726219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4135-c3a5-498a-a6d5-55181c263f9a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.726753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4135-c3a5-498a-a6d5-55181c263f9a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.727209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4135-c3a5-498a-a6d5-55181c263f9a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.730124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 175/338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:20.739300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a87d-b866-4d72-b118-79e9cfd16974 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.739705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a87d-b866-4d72-b118-79e9cfd16974 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.740221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a87d-b866-4d72-b118-79e9cfd16974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.788615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f129a87d-b866-4d72-b118-79e9cfd16974 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:20.789852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f129a87d-b866-4d72-b118-79e9cfd16974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:20.845542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b2076-5a36-4948-9e7a-f59ab87c8289 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:20.898380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:20.926557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:20.928459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.928988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.929489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.930892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:20.931835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:20.934994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:20.943566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 176/339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:20.944993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ca79-e645-4359-9c50-8c6da1902f16 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.945295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ca79-e645-4359-9c50-8c6da1902f16 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.945580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ca79-e645-4359-9c50-8c6da1902f16 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.947227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 177/340] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:20.953583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 164/341] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:20.953821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:20.954116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:20.954352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:20.963422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:20.991741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:20.992709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:21.136037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:21.144296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 178/342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:21.145141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:21.198759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1ffc-deb1-496e-88b9-32c8b4480488 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:21.239754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:21.240386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:21.240670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:21.241061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:21.322436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3149c40-b362-44a4-99c0-9c78bd7c66fd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:21.359102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:21.360663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:21.366857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:21.404634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:21.405421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:21.405708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:21.405987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:21.430655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:21.441615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:21.443358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 179/343] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:21.444889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:21.519673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:21.554819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 165/344] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 11:57:21.555989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:21.625658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edde4d-1a8b-4990-8fce-0b36c49e9895 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:21.673884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:21.674575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:21.674863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:21.675125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:21.701946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:21.707097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:21.708802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:21.710391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 180/345] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:21.714551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:21.763673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187837db-16e6-4235-9bfc-6d172317b125 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:21.811149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:21.811797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:21.812089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:21.812376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:21.813110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:21.816778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:21.818234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:21.829941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:21.840135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 166/346] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:21.841041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:21.919004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:21.933089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f47b-ab97-4eff-9642-ea60fe72ab6e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.013480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd6d5-5ffd-405b-830c-b3a1024c31e0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.035696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.036762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.037234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.037693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.040000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.042858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.045858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 181/347] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:21 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:22.047252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:22.061675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.062317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.062760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.062956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.063675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:22.063994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.065404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.076700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 167/348] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:22.077619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:22.236889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:22.240232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27afc23-7f4d-4a24-ae35-f54ec677c78c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.241173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594a34-c91f-4b36-8d61-ae9abffef2d0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.274846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:22.292025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.292707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.292998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.293285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.302063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.304634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a77c4-5875-4b56-b27e-e3c6d08e52c6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.306747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 168/349] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:22 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:22.308970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d1e-e435-42a0-b1ee-d8c7416b05cd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.309288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d1e-e435-42a0-b1ee-d8c7416b05cd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.309568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d1e-e435-42a0-b1ee-d8c7416b05cd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.310943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 169/350] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:22.315371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15d1e-e435-42a0-b1ee-d8c7416b05cd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:22.320901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.321968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.322523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.323776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.449858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15d1e-e435-42a0-b1ee-d8c7416b05cd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.471074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.474240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.538760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.540278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.540816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.541312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.605075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:22.645538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 182/351] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:22.646484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:22.656941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:22.689293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.692178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40252257-9352-46ac-9716-e73e4c6fad7a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.829762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4844807-d441-47a1-b670-6041dcb87d43 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:22.855476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 170/352] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:22.857273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00296-8354-4667-a9f1-71be4015574e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.857778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00296-8354-4667-a9f1-71be4015574e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.858270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00296-8354-4667-a9f1-71be4015574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.875715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:22.876362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.876637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.876914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.877720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:22.878070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:22.880567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbc554-261f-46e4-8498-23a7b65d4d03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:22.886229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-02f00296-8354-4667-a9f1-71be4015574e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:22.889613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 183/353] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:22 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=a459998da52847ad9ba273f6520dabca => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:22.889804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-02f00296-8354-4667-a9f1-71be4015574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:22.890821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-23ab-4c95-8b8b-7dd08906e6ad None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:22.891157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-23ab-4c95-8b8b-7dd08906e6ad None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:22.891604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642dddb-23ab-4c95-8b8b-7dd08906e6ad None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:22.895145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 184/354] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:22.896420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642dddb-23ab-4c95-8b8b-7dd08906e6ad None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:22.991004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.014553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 171/355] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:23.022487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34450e-77d4-4c0a-af11-23f21187503b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.022487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34450e-77d4-4c0a-af11-23f21187503b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.022487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34450e-77d4-4c0a-af11-23f21187503b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.023767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 172/356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:23.031287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34450e-77d4-4c0a-af11-23f21187503b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.042419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.106711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642dddb-23ab-4c95-8b8b-7dd08906e6ad None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.153226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.153898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.154183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.154504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.156119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:23.157703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be4f55-5ad6-4ffc-a596-997ae0d680ac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:23.161202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 185/357] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:22 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:23.161202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc63c-81b0-4cc0-9259-7ddc8443faf0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.161531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc63c-81b0-4cc0-9259-7ddc8443faf0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.161655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc63c-81b0-4cc0-9259-7ddc8443faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.189660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7efbc63c-81b0-4cc0-9259-7ddc8443faf0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:23.192732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7efbc63c-81b0-4cc0-9259-7ddc8443faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:23.209902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34450e-77d4-4c0a-af11-23f21187503b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.278418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.279393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.279393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.279676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.280832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:23.282313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:23.283495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 186/358] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:23.284325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 173/359] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:23.285143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.285296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.285484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.285767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.323856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:23.325078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:23.387465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.421558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.436540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 187/360] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:23.438161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.440146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a030f-1848-4351-bb48-e2d5fa6aa993 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.518117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.519197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.519696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.520297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.536574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:23.547204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:23.548149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:23.548938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:23.549536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 174/361] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:23.550993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.597935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05d12-c580-44a2-ac0e-305c21954265 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.655318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.656889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.657692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.658431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.661269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:23.664728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:23.668978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 188/362] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:23.670877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.685550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed6ff-3ff6-4c5a-a08c-d4f4d27e5f99 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.708206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.736886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.738391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.739184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.739898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.742223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:23.745344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:23.749262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 175/363] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:23.751526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.792567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:23.845218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde6132-faf3-4987-a62b-8c8276ecd1d8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.900030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e369-8941-4e29-b01e-f9af60436098 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:23.909550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.910116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.910392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.910835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.924759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:23.930187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:23.931321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 189/364] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:23.932486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:23.960949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:23.962093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:23.964603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:23.964603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:23.980457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:23.985664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:23.987394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 176/365] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:23.988864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.058029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:24.121193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5f7f1-a516-4239-b2da-e591902c34dc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.124298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076daa-a2d7-46e3-86b9-0a5bb765068a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.175115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:24.178622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.179463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.179820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.180394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.181377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=2f8e28c0f46844e18ce1143582f5c068) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:24.182632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:24.184350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:24.195245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.196542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.196757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 177/366] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:24.197466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.198758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.199113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.200438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:24.201198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:24.203772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:24.226958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 190/367] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:24.227915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.332771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0b8a-5390-4925-b3b1-beeb05a5f01f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.372021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:24.405332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.405990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.406286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.406611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.408334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:24.408672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:24.411582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:24.420066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d7f2-918e-49a4-876a-8069f139f076 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.422362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 178/368] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:24 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:24.423291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.488837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.489958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.490411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.490848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.492248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:24.492634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:24.495194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:24.506474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 191/369] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:24.507296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.579110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d019b-d949-4bef-b348-1c7f7aa09829 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.631651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.632927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.633381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.633868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.637040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:24.637590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:24.641741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:24.651100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:24.676722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 179/370] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:24.679858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:24.786077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48618773-bb44-43e7-a97f-55e97c560072 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.799912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:24.896195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.896850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.897135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.897421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:24.941288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa93-2b84-4f01-b52d-6840b1bf85fc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:24.991629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:24.993035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:24.993718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:24.994401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.024933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.027731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.120377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.127424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.130464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.211531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.216688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 192/371] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:25.223540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.301390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 180/372] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:25.302864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.395276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9bbc-d139-4234-9066-e894dbc3b9a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:25.443401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:25.444904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.445388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.445879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] PATH_INFO: `/v3/users/a7575b884f5c42309bce60b9624144bf` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.447348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] RBAC: Authorizing `identity:get_user(user_id=a7575b884f5c42309bce60b9624144bf)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.449291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.451772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 193/373] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/users/a7575b884f5c42309bce60b9624144bf => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:25.452851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.473365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b0a4-2f02-4590-af5f-2725e740773f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:25.481011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.520117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:25.520782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.521064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.521343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] PATH_INFO: `/v3/projects/fa9288278a154c5e9a414320fa6388fa` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.522711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] RBAC: Authorizing `identity:get_project(project_id=fa9288278a154c5e9a414320fa6388fa)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.524476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1397e6f-d421-4d9c-8bba-83fa5d90c9ff None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.526737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 181/374] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/projects/fa9288278a154c5e9a414320fa6388fa => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:25.527953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65047d85-8d20-4142-91d5-e90074cd9fb4 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.528236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65047d85-8d20-4142-91d5-e90074cd9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.528521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65047d85-8d20-4142-91d5-e90074cd9fb4 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.534862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 182/375] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:25.539741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65047d85-8d20-4142-91d5-e90074cd9fb4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.549501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.600246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e695ef-43dd-4560-bbc1-7fc5cf11305c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:25.638523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:25.639195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.639480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.639761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.641017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.642534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.644599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 194/376] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:25.645591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.714466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65047d85-8d20-4142-91d5-e90074cd9fb4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:25.754435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:25.755619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.756183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.756663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.757661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] RBAC: Adding query filter params (role.id=81e19493c60b4327ada6a0ab081e9b25, user.id=a7575b884f5c42309bce60b9624144bf, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:25.758340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.760908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e0bb3-af78-4c2f-97cd-6903476e886f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.766746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.781435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 183/377] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/role_assignments?user.id=a7575b884f5c42309bce60b9624144bf&scope.system=all&role.id=81e19493c60b4327ada6a0ab081e9b25 => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:25.783274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.783831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.784369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.795666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889da77-8a88-4b01-a62d-81f7e1126e69 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:25.807111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:25.808831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:25.846252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:25.846895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:25.847331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:25.847621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] PATH_INFO: `/v3/groups/bd18d5b1940e4fc59fb53b172fc77351` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:25.854954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] RBAC: Authorizing `identity:get_group(group_id=bd18d5b1940e4fc59fb53b172fc77351)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:25.856432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:25.858500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 195/378] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/groups/bd18d5b1940e4fc59fb53b172fc77351 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:25.859320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.893959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:25.906493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 184/379] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:25.907744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:25.973902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa17e-9364-4a25-b0c0-c6d054b37130 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.039233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932adea-abc5-4836-a10f-2cbc5447f4d6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.045294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.045966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.046251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.046553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.050166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.051685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.053741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 196/380] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:26.054590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:26.085640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.087155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.087833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:26.089300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.090167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.091559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] RBAC: Adding query filter params (group.id=bd18d5b1940e4fc59fb53b172fc77351, role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=fa9288278a154c5e9a414320fa6388fa) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:26.092091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.094632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.101866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 185/381] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:25 2022] GET /identity/v3/role_assignments?group.id=bd18d5b1940e4fc59fb53b172fc77351&scope.project.id=fa9288278a154c5e9a414320fa6388fa&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:26.103171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:26.179778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:26.224228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd695e8-f910-49e9-9852-644c44a8be24 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.263346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.263631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.264016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.264256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.272467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e899c71-394d-4a96-a82b-e86290a58018 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.287673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:26.294051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:26.295063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:26.295854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:26.302919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 197/382] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:26.304887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:26.325198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.326478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.327022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.327604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.328784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=2f8e28c0f46844e18ce1143582f5c068) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:26.329409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.331264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.341236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 186/383] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:26 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=a459998da52847ad9ba273f6520dabca => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:26.467367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:26.509895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9ef54-75b8-492c-9574-d641bc097909 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.572397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.573947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.574607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.575184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.576444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:26.577166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.579036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.593880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 198/384] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:26.602020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:26.735347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e34d-e0bf-47f7-9c1a-43b8b4f79d8b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.767639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:26.783663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda951a0-c03e-44af-b129-9252602661da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.784682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda951a0-c03e-44af-b129-9252602661da None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.785114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda951a0-c03e-44af-b129-9252602661da None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.785537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda951a0-c03e-44af-b129-9252602661da None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.787278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda951a0-c03e-44af-b129-9252602661da None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.789199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda951a0-c03e-44af-b129-9252602661da None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.792163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 187/385] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:26 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:26.797769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:26.925109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f40f-f79d-44f8-9da9-2f132078a36e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:26.966644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:26.967610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:26.968043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:26.968513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:26.971201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:26.972923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e08ecc-b225-45a2-8253-5d94492c8248 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:26.975247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 199/386] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:26 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:26.981432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda951a0-c03e-44af-b129-9252602661da None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:27.013643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14c43-8aff-471c-8959-418454c0bed4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.014186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14c43-8aff-471c-8959-418454c0bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.014627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d14c43-8aff-471c-8959-418454c0bed4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.016788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 200/387] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:27.024372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.025226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.026230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.051205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:27.053421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:27.055891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:27.141186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 201/388] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:27.170685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:27.172393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda951a0-c03e-44af-b129-9252602661da None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:27.250337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:27.251057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.251340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.251616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.256213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, group_id=81bd6ccd8fad4e6d94d3730a295f56a8, role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:27.257686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:27.282431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 188/389] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 3 11:57:26 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/a459998da52847ad9ba273f6520dabca => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:27.334049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8654e-73ae-4136-b17a-63d7bff041b3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:27.384383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:27.385645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.385966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.386268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.397057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:27.404647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:27.410057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:27.411041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:27.411805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 202/390] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:27.418960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:27.496552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:27.561586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1971f0-e4e7-437c-9f0f-7e3c24a927da None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:27.599196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:27.599826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.600113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.600383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.601100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:27.601404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:27.602960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6593d5-4676-4654-b074-89b958309ab6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:27.612135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 189/391] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:27.618519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:27.749940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3ff7-beae-4f92-8b25-af06d6d46a91 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:27.790258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:27.790941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.791223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.792159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.793438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:27.794923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:27.796936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 203/392] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:27 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:27.801718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c6ee-bf39-49cf-bcf4-f081638954a2 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.802021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c6ee-bf39-49cf-bcf4-f081638954a2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.802306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2c6ee-bf39-49cf-bcf4-f081638954a2 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.804221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 190/393] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:27.805170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:27.810847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:27.811246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:27.811673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:27.842135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:27.844178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:27.912945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:27.955590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aa7ad-7350-408f-b7f2-97bc08ecffff None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.011294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 191/394] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:28.020562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.021405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:28.021788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:28.022159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:28.023727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:28.025336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:28.027725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 204/395] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:27 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:28.033084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:28.051788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:28.117148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:28.222192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335670f-ffda-48bc-8d62-e7b8bbeff0c9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.250808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02027e2-525a-4bef-b756-1c360c3257f2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.268630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.271170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:28.272137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:28.272904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:28.277339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:28.300119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:28.310594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:28.311668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:28.312426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:28.322776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 205/396] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:28.327609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:28.342663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.347074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:28.347813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:28.348316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:28.353010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, group_id=81bd6ccd8fad4e6d94d3730a295f56a8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:28.358571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:28.386790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 192/397] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 3 11:57:28 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:28.535177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89535-6aa1-447f-8bb8-d8eb5f18d088 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.591450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.592106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:28.592490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:28.592818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:28.593771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:28.594261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:28.595702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:28.610860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 206/398] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:28.613802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:28.746115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bcf25-a786-49a3-abae-2a9adeab7ccd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.747996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:28.803793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.804472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:28.804763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:28.805049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:28.806246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:28.807801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:28.809787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 193/399] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:28 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:28.815534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:28.899770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:28.958863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7497-bf72-49ea-899e-03f39d0c1b44 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:28.999194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:28.999829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.000168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.000450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.002108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:29.003752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b490dd-a653-4c5b-9d01-79dccd7a5d92 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:29.006361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 207/400] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:28 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:29.012820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.148973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4108-c666-437c-b021-6940ec88ac96 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.149346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4108-c666-437c-b021-6940ec88ac96 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.149587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4108-c666-437c-b021-6940ec88ac96 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.151304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 208/401] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:29.160669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6a18c-6465-46b4-838d-39b9aef04264 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.160983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6a18c-6465-46b4-838d-39b9aef04264 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.161238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6a18c-6465-46b4-838d-39b9aef04264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.191002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b2b6a18c-6465-46b4-838d-39b9aef04264 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:29.192268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b2b6a18c-6465-46b4-838d-39b9aef04264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:29.241779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d9723-e82b-41e4-924d-46bddd4dff17 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.281500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 209/402] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:29.282904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cf5f-7d29-4add-b3f5-ba828f703c7a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.283204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cf5f-7d29-4add-b3f5-ba828f703c7a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.283486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cf5f-7d29-4add-b3f5-ba828f703c7a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.284209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.284940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 210/403] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:29.285570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.286066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.286682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.288999 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] RBAC: Authorizing `identity:create_grant(project_id=202024ddf3fa4b39a6ff8842f40955ae, group_id=81bd6ccd8fad4e6d94d3730a295f56a8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:29.290610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b288d7-c063-4904-911b-983d2102e000 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.290905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b288d7-c063-4904-911b-983d2102e000 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.291187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b288d7-c063-4904-911b-983d2102e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.292177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:29.311279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-64b288d7-c063-4904-911b-983d2102e000 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:29.312711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-64b288d7-c063-4904-911b-983d2102e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:29.319482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 194/404] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 3 11:57:29 2022] PUT /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:29.320768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.365934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:29.376939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:29.406111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 211/405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:29.425950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b288d7-c063-4904-911b-983d2102e000 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.462485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5517-4c39-4fbf-9ef6-cc1ddc2fc42f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.505131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.506230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.506808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.507293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.521043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:29.527586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:29.528526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:29.529288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:29.532389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 195/406] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:29.538547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.545231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b288d7-c063-4904-911b-983d2102e000 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.585879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.586756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.587058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.587344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.601485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:29.607241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:29.608114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:29.608869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:29.612454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 212/407] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:29.615458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.652125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:29.664664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756722c3-e500-4875-83c9-6cdbb8506343 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.674970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:29.707062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.708053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.708557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.709042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.709957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:29.710476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:29.712222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:29.722687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 196/408] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:29.728791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.741182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b340-1123-40cd-91aa-82a50f7d43d8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.785380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.785953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.786245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.786779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.787884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:29.788201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:29.790160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:29.806545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 213/409] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:29.811228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.862200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5e9c7-fc32-45f0-b7a7-85bbd8335d47 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.910117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:29.912266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:29.912266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:29.912266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] PATH_INFO: `/v3/groups/bd18d5b1940e4fc59fb53b172fc77351` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:29.913477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] RBAC: Authorizing `identity:get_group(group_id=bd18d5b1940e4fc59fb53b172fc77351)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:29.914887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:29.917347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 197/410] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/groups/bd18d5b1940e4fc59fb53b172fc77351 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:29.926545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:29.957746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:29.965573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44850ee3-761e-43f9-9c0a-8caaa9db4213 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:29.979802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:30.052684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.053281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.053567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.053849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.059279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:30.060687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e700-1675-4b4b-bcf5-fde6fcd08077 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:30.060848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:30.062774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 214/411] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:30.082086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:30.108715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.110862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.111700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.112000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] PATH_INFO: `/v3/projects/fa9288278a154c5e9a414320fa6388fa` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.113943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9288278a154c5e9a414320fa6388fa)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:30.117062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:30.119293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 198/412] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:29 2022] GET /identity/v3/projects/fa9288278a154c5e9a414320fa6388fa => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:30.126186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:30.240255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a87fa-7213-4494-8f4f-a8140a471051 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:30.257710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:30.282143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb2dcd-9fe2-47a7-acd7-5d2236a50e09 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:30.290842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.292080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.292368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.292655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.293958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:30.296175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99ac8c-dace-41c5-aa2e-6d6ebdb30458 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:30.302539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 215/413] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:30 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:30.306156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798cdd-a57e-4de2-84ae-89d0b713239b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.306392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798cdd-a57e-4de2-84ae-89d0b713239b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.306728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43798cdd-a57e-4de2-84ae-89d0b713239b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.310907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 216/414] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:30.310907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43798cdd-a57e-4de2-84ae-89d0b713239b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:30.339557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.340440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.340826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.341209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] PATH_INFO: `/v3/projects/fa9288278a154c5e9a414320fa6388fa/groups/bd18d5b1940e4fc59fb53b172fc77351/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.343889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9288278a154c5e9a414320fa6388fa, group_id=bd18d5b1940e4fc59fb53b172fc77351, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:30.345130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24aaa-9bb4-48ce-98ba-7d3687cafdda None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:30.363219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 199/415] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 3 11:57:30 2022] PUT /identity/v3/projects/fa9288278a154c5e9a414320fa6388fa/groups/bd18d5b1940e4fc59fb53b172fc77351/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:30.364979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.365367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.365745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.389050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:30.399318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:30.401848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:30.528382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43798cdd-a57e-4de2-84ae-89d0b713239b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:30.566757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 200/416] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:30.597672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:30.598029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.598731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.599020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.599394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.602776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e28c0f46844e18ce1143582f5c068, group_id=81bd6ccd8fad4e6d94d3730a295f56a8, role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:30.604781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:30.634724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 217/417] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 3 11:57:30 2022] PUT /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068/groups/81bd6ccd8fad4e6d94d3730a295f56a8/roles/a459998da52847ad9ba273f6520dabca => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:30.742875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:30.778104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fae53-c6a5-4abe-8fca-bdb8f90e9d60 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:30.833081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:30.833686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:30.833974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:30.834264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:30.854720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c9ab1728-10ff-46ed-a2c7-a4394801bcbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:30.864953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:30.865887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:30.866658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:30.867717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 201/418] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:30.873615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:31.071094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30032a0-62d2-4f23-bde7-beaabd70b07e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:31.075142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:31.094480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33533d-957e-4627-9e7f-9bacb4c82b96 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.095342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33533d-957e-4627-9e7f-9bacb4c82b96 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.096108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33533d-957e-4627-9e7f-9bacb4c82b96 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.098557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 202/419] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:31.104552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd924-3450-44de-8a78-098d903d7573 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.104863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd924-3450-44de-8a78-098d903d7573 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.105133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fd924-3450-44de-8a78-098d903d7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.142951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-216fd924-3450-44de-8a78-098d903d7573 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:31.144016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-216fd924-3450-44de-8a78-098d903d7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:31.147020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:31.147662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.147948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.148227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.148961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:31.149273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:31.151247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:31.176990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 218/420] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:31.184009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:31.336504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 203/421] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:31.372035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fd924-3450-44de-8a78-098d903d7573 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:31.422273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c63ff-7cca-40b3-b5db-8c46fa616a1d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:31.487611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:31.488311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.488605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.488890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.524051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:31.543826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:31.592402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fd924-3450-44de-8a78-098d903d7573 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:31.616404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:31.617887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:31.669831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:31.670412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.670722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.671000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.694474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:31.700324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:31.701214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:31.701985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:31.703593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 204/422] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:31.709755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:31.814291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 219/423] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:31.825965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:31.906590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3bee-c28b-4c05-b5ab-c3ed67f754cb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:31.913344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:31.944586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:31.956692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:31.957345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.957669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.958018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.958837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:31.959223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:31.960768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396516-c60d-449d-b827-95a3f2493f1b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:31.983131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 205/424] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:31.984093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75371-388b-429a-ab07-0c33ee34befd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:31.984644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1287-b5cd-412a-af6b-3caf34138420 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:31.984940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1287-b5cd-412a-af6b-3caf34138420 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:31.985222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1287-b5cd-412a-af6b-3caf34138420 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:31.986691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 206/425] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:31.987518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1287-b5cd-412a-af6b-3caf34138420 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.031301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.032342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.032865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.033352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.034863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.036574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617a64f-3a22-40ff-8c41-e417554427bd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.038615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 220/426] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:31 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:32.040213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52747a5-0487-4597-9144-c43c55802180 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.040717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52747a5-0487-4597-9144-c43c55802180 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.041236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52747a5-0487-4597-9144-c43c55802180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.060660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a52747a5-0487-4597-9144-c43c55802180 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:32.062226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a52747a5-0487-4597-9144-c43c55802180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:32.137349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 221/427] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:32.139108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52747a5-0487-4597-9144-c43c55802180 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.184276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1287-b5cd-412a-af6b-3caf34138420 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.213954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:32.251165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.251804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.252099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.252510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.283017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52747a5-0487-4597-9144-c43c55802180 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.344295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.346622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.347178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.347807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.349355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.352290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.352598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:32.358280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 222/428] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:32.361136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.368809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.369426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.513449 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc7fa-5850-46ca-9f64-1ccd0b6727d6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.558278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:32.566788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.567847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.568269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.568787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.571820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 207/429] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:32.572962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.587618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:32.592984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:32.594301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 11:57:32.595130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:32.599288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 223/430] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:32.600277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.703002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:32.716218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6255-8309-45a6-9e52-831167034217 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.755067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e6990-5da2-4888-a1d4-e2ee33cd6a32 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.763618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ce283-3680-4215-a575-f91590332717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.764315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ce283-3680-4215-a575-f91590332717 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.764671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ce283-3680-4215-a575-f91590332717 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.764955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ce283-3680-4215-a575-f91590332717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.765793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ce283-3680-4215-a575-f91590332717 None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:32.766108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ce283-3680-4215-a575-f91590332717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.768446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ce283-3680-4215-a575-f91590332717 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.779244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 208/431] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=a459998da52847ad9ba273f6520dabca => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:32.780388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ce283-3680-4215-a575-f91590332717 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.823950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.825001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.825513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.825985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.831415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.833381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.835830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 224/432] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:32.842948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:32.927575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ce283-3680-4215-a575-f91590332717 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:32.964775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:32.971841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:32.972658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.973000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.973329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.974067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:32.974407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:32.976334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec17e-2afa-44f4-8297-841b5acd2a2e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:32.987103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 209/433] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:32.988555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b532-909b-4ecc-a0ee-94c56d09775c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:32.988850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b532-909b-4ecc-a0ee-94c56d09775c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:32.989131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b532-909b-4ecc-a0ee-94c56d09775c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:32.990736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 210/434] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:32.993967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9b532-909b-4ecc-a0ee-94c56d09775c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.017379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.030793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756b23-c764-4fd8-aa5a-c9bf4a3d4a81 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.086237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.089028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.089028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.089028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.090758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.092933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c20ab8-a15d-4535-8c07-828e527f8775 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.095195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 225/435] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:33.097067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.097352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.097909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.122784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:33.124002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:33.144637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9b532-909b-4ecc-a0ee-94c56d09775c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.179157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.179790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.180074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.180353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.192661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 226/436] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:33.193508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.248701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.250165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d22d1-6087-43c4-a4d2-a07d4b610a3f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.252975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.268276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.302130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53c9a-0bd6-4ee0-b8f1-ba6fe2378e66 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.335834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.336454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.336803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.337085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.337888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=2f8e28c0f46844e18ce1143582f5c068) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:33.338928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.340357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e87f6-c3f8-4d52-be07-c33fe68e0adb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.346315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 227/437] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:33.347510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5afd-7afe-4c36-9a80-ecb0c0e3d86a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.347803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5afd-7afe-4c36-9a80-ecb0c0e3d86a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.348084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5afd-7afe-4c36-9a80-ecb0c0e3d86a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.349327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 228/438] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:33.350136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac5afd-7afe-4c36-9a80-ecb0c0e3d86a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.361628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 211/439] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:33.368098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.368386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.368664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.388469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:33.390030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:33.471092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 212/440] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:33.472961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.495369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac5afd-7afe-4c36-9a80-ecb0c0e3d86a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.518616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.536823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.539104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.539104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.539104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.539104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.552671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:33.559045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:33.560020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:33.560785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 229/441] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:33.561415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.599011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5297a8-8921-41c5-b1fc-87e13cd5da28 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.633670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.634317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.634647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.634976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] PATH_INFO: `/v3/projects/202024ddf3fa4b39a6ff8842f40955ae` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.636941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] RBAC: Authorizing `identity:get_project(project_id=202024ddf3fa4b39a6ff8842f40955ae)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.638557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.640379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 213/442] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/projects/202024ddf3fa4b39a6ff8842f40955ae => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:33.641143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.664113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6417a-191b-4d3b-9b80-b39be77ba861 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.696680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.697341 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.698221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.698530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.709818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:33.714762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:33.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:33.716366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 230/443] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:33.716997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.742515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149effb4-befd-4d29-9b46-f72d940d490f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.757200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.757475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.779169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.779717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.780002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.780282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.781026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:33.781335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.782748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.790894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 214/444] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:33.792238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.816040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68980-b02a-4096-abdd-cfe39610dd52 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.848616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.849252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.849537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.849820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.851018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.852469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.854579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 231/445] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:33.855337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.898748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63cc0-0b48-4ee1-ac18-f860dd304685 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.934725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.935409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.935628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.935913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:33.936635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:33.936944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:33.938421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:33.947181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 215/446] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:33.948117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:33.960188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b985498-827f-4e15-9fb9-39dbc775410c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:33.969346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.989873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:33.996384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:33.997021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:33.997315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:33.997598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.051137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608350b-e023-4bf3-a8dc-e40a9e2238b9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.064905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.066370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.084644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.085260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.085543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.085817 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.086633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=271aea4edf604c2b829a1a2a8b83289e, scope.project.id=202024ddf3fa4b39a6ff8842f40955ae) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:34.086948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.088404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.094188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 216/447] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=202024ddf3fa4b39a6ff8842f40955ae&role.id=271aea4edf604c2b829a1a2a8b83289e => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:34.095007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.190337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 232/448] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:34.196078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.207863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.219351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfd26-8f31-4528-83cd-fb2dce8c910e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.221259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.265222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.266017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.266724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.267012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.313998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f40d8-54a6-4ef5-b0b1-574d1e11273b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.345219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.346734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.355430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.355683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.355936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.356214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] PATH_INFO: `/v3/projects/fa9288278a154c5e9a414320fa6388fa` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.357400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] RBAC: Authorizing `identity:get_project(project_id=fa9288278a154c5e9a414320fa6388fa)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.358892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.360591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 233/449] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/projects/fa9288278a154c5e9a414320fa6388fa => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:34.366618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.464613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 217/450] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:34.471064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.473662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.474347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.507041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0d2c-fca6-4e5d-9804-7c6c3055885d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.550237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.551006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.551294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.551574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] PATH_INFO: `/v3/groups/bd18d5b1940e4fc59fb53b172fc77351` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.552785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] RBAC: Authorizing `identity:get_group(group_id=bd18d5b1940e4fc59fb53b172fc77351)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.554244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.556743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 234/451] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/groups/bd18d5b1940e4fc59fb53b172fc77351 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:34.562273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.589862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb678a-fbe4-4bfc-a813-1142d9e4efcb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.631894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.632544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.632831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.633108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] PATH_INFO: `/v3/projects/2f8e28c0f46844e18ce1143582f5c068` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.634961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] RBAC: Authorizing `identity:get_project(project_id=2f8e28c0f46844e18ce1143582f5c068)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.636700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.638411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 218/452] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/projects/2f8e28c0f46844e18ce1143582f5c068 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:34.644205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.682523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d66be-92d5-4bab-b8bd-de8d655b2953 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.732168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.745437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.746093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.746346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.746645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.747437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] RBAC: Adding query filter params (group.id=bd18d5b1940e4fc59fb53b172fc77351, role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=fa9288278a154c5e9a414320fa6388fa) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:34.747747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.749194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.755655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 235/453] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/role_assignments?group.id=bd18d5b1940e4fc59fb53b172fc77351&scope.project.id=fa9288278a154c5e9a414320fa6388fa&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:34.771510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac18526-1fbe-439c-acea-fc4e8410ceff None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.812202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.812902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.813191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.813474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] PATH_INFO: `/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.814814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] RBAC: Authorizing `identity:get_group(group_id=81bd6ccd8fad4e6d94d3730a295f56a8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.816338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb500c-f54f-4a12-aa67-d0d3feead7ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.818060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 219/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/groups/81bd6ccd8fad4e6d94d3730a295f56a8 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:34.825315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:34.840733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:34.944824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1bb7-8b14-4d32-adc4-68549584d6f9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:34.981525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:34.982149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:34.982436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:34.982877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:34.983679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] RBAC: Adding query filter params (group.id=81bd6ccd8fad4e6d94d3730a295f56a8, role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=2f8e28c0f46844e18ce1143582f5c068) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:34.983997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:34.985429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02452c6-8c84-43b5-b43a-2fb2b8265dea None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:34.991370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 236/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 3 11:57:34 2022] GET /identity/v3/role_assignments?group.id=81bd6ccd8fad4e6d94d3730a295f56a8&scope.project.id=2f8e28c0f46844e18ce1143582f5c068&role.id=a459998da52847ad9ba273f6520dabca => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:37.664547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c64a4-9c45-4d73-9673-36181a33bb32 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:37.665091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c64a4-9c45-4d73-9673-36181a33bb32 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:37.665091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c64a4-9c45-4d73-9673-36181a33bb32 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:37.666528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 220/456] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:37.672204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:37.672672 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:37.672766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:37.673132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacc8-4df0-46ac-8ab8-eaf6f5e3e2d8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:37.673654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacc8-4df0-46ac-8ab8-eaf6f5e3e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:37.674128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacc8-4df0-46ac-8ab8-eaf6f5e3e2d8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:37.675959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 221/457] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:37.681482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:37.682080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:37.682583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:37.703951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:37.705174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:37.712222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:37.713997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:37.843757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 237/458] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:37.844025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 222/459] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:37.869027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:37.871257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:37.897429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.026941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:38.055845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e6c84-92f4-421c-9a20-2965e5775d4b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.091755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb29a-4a55-4593-9dc7-b77ec5b1a57d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.148097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.148686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.148976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.149257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.163178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.163854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.164140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.164419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.176158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.177651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.187802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.189293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:38.207568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:38.208657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:38.209488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:38.209488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:38.209488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.209488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:38.216631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 238/460] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:38.217957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c7aabdd8-4146-4cc0-ada2-61dd70eaf64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:38.224349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:38.225368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:38.226424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:38.226424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:38.226424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.226424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:38.232415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 223/461] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:38.244016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d1f-b884-430f-99f8-053c1a638aaa None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.244873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d1f-b884-430f-99f8-053c1a638aaa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.245133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59402d1f-b884-430f-99f8-053c1a638aaa None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.246803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 224/462] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:38.247545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402d1f-b884-430f-99f8-053c1a638aaa None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.301681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:38.359671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16060bd3-c748-4f3f-a323-1380f9cc9dc0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.392539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59402d1f-b884-430f-99f8-053c1a638aaa None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.403442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.404121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.404517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.404894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.406064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:38.406513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.408316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0d12-3caf-4de2-adee-a99eaaa5c83f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.420519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:38.424479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 239/463] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:38.426021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.426411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.427191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.444205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.445014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.445402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.445778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.446614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:38.447025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.448917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.451981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:38.453328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:38.479557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 225/464] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:38.480431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.537506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 240/465] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:38.538355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.597552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:38.611376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c9d49-af4e-41d9-ad8a-c8d62e8a0d9c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.651546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.652274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.652624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.652905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.653652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.655104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a2ccd-80db-4a54-a3a8-a43015cf2cf8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.663839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab93d18-7685-4dd6-9a2e-c2374e92c2cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.686939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 226/466] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:38 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:38.688259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafbe07-d848-4af2-9e9f-a55d6f7b72ed None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.688552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafbe07-d848-4af2-9e9f-a55d6f7b72ed None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.688832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafbe07-d848-4af2-9e9f-a55d6f7b72ed None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.690398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 227/467] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:38.690992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafbe07-d848-4af2-9e9f-a55d6f7b72ed None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.718679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.720934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.721432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.721860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.723105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.725792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5bdf3-86c8-4099-b69c-d6eed8baa770 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.753338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:38.772122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 241/468] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:38 2022] POST /identity/v3/users => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:38.774578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.776340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.777350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.804359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:38.807268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:38.844638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafbe07-d848-4af2-9e9f-a55d6f7b72ed None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:38.918937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 242/469] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:38.938309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:38.939002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:38.939289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:38.939567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:38.945050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.954759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:38.956281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:38.973775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:38.974726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:38.975567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:38.975567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:38.975567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:38.975567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:38.975567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 228/470] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:38.981533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:38.988353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.082845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a968b4-0201-49f9-ba72-78efbecf74b5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.085941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.105564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34478d1-4341-4da9-b39d-9207c57a6bf0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.129324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.130137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.130618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.131089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.145192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.146224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.146711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.147186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.148055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:39.148533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.149909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.150208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12855-76b3-46f1-b92e-f404fdf5a1aa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.151972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.165414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 229/471] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:39.166553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eca6-5d02-4cba-8ecb-8aca649ef3fa None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.166844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eca6-5d02-4cba-8ecb-8aca649ef3fa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.167121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eca6-5d02-4cba-8ecb-8aca649ef3fa None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:39.168261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:39.169505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:39.170547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:39.170547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:39.170547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:39.170547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.170761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 230/472] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:39.170840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 243/473] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:39.173700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.173988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.174269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.175259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:39.198513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:39.199920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:39.266179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.288610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e4d7-505b-4ac5-b6f7-aa393a71f970 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.293397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 231/474] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:39.294470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:39.341144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.342173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.342666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.343146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.343979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.345610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.375065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 244/475] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:39 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:57:39.376719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:39.405447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.433680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3181256-78e2-4462-ae4c-396e0a0418c3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.486471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.486471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.486471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.486471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.486904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:39.486904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.487534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.502913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 232/476] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:39.508511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:39.618066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3bb13-0427-45c7-8477-6ac520fe8dc7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.657360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5de88-57a2-4749-9f2f-bc313f44974d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.664399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.665725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.665725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.665725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.666778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.668785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.683361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.sql.core [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 11:57:39.683361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 11:57:39.683361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [parameters: {'id': '7b700dbd8e1243fe96e5c1f06b1546d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 11:57:39.683361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 11:57:39.707708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result.read() Aug 03 11:57:39.708221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return ref.to_dict() Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:57:39.709262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application yield resource Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise self.value Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application session.commit() Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 11:57:39.710360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.session.flush() Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application compat.raise_( Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 11:57:39.711467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:57:39.712739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result.read() Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:57:39.713925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [parameters: {'id': '7b700dbd8e1243fe96e5c1f06b1546d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:39.715416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 11:57:39.716393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.717503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 245/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 3 11:57:39 2022] POST /identity/v3/roles => generated 144 bytes in 338 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:39.718369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.718883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.719121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.719860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:39.720412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:39.721502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:39.725116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.740568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:39.766491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 233/478] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:39 2022] POST /identity/v3/users => generated 249 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:39.868003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a1a0-789a-4eae-9f4a-ee79d8d7c7d5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:39.907336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:39.907997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:39.908283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:39.908563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:39.920696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2fcb87bf-bbe1-41eb-a455-b855014972bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:39.926348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:39.927273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:39.928304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 246/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:57:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:39.935629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:40.044148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42cc3-2f95-4d6a-b2cf-ffa08a04cc4b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:40.080798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:40.081805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:40.082287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:40.082791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:40.083710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:40.084228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:40.085823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e3d6-b7a6-40d6-9a7b-29e09dab7d8d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:40.095336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 234/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:41.236537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d73a6-5540-4e09-a2af-40fc802cf381 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.237060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d73a6-5540-4e09-a2af-40fc802cf381 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.237373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d73a6-5540-4e09-a2af-40fc802cf381 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.238920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 247/481] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:41.245519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.245938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.246125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.271022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:41.272387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:41.345585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714dc29-e0ac-4ed1-b26f-94cec6bce8d5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.345844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714dc29-e0ac-4ed1-b26f-94cec6bce8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.346129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714dc29-e0ac-4ed1-b26f-94cec6bce8d5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.347998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 248/482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:41.352984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.353269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.354089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.362130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:41.385917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:41.387607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:41.399000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 235/483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:41.451783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:41.475059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:41.509897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 249/484] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:41.557820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:41.596050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a9f7-d012-41e6-9ceb-4f942136ee3f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:41.637148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:41.638312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.638854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.639326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.652070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:41.657718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:41.658737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:41.659491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:41.662327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 236/485] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:41.670679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:41.725267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:41.731250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb400de-2661-4b6a-b24d-f03b93bb8109 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:41.772732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:41.773315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.773595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.773870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.811098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:41.811579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcd05-394e-4a20-aa4e-04265e8f3e84 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:41.816139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:41.817038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:41.818427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 250/486] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:41.823408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:41.860467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:41.862552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:41.862841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:41.863119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:41.863850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:41.867688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:41.867688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:41.888282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 237/487] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:41.890981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:41.938930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.046615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f35e1a-9b60-4289-a51e-5901d64a35b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.106494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc38c8-37d9-4e12-b168-d22687e80ebe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.106715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.107238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.107518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.110460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.110460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:42.110460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.110460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271bc5a-da72-418c-a1b8-b5695b8927ed None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.121669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.126734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 251/488] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:42.128368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548decc4-5df8-4f4d-81a9-de63001abd00 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.128957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548decc4-5df8-4f4d-81a9-de63001abd00 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.129454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548decc4-5df8-4f4d-81a9-de63001abd00 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.136393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 252/489] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:42.137777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548decc4-5df8-4f4d-81a9-de63001abd00 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.155818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.156569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.156852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.157129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.180501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.182030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-3ec31902-1b05-42ad-8c20-eacef1386fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:42.215628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:42.216537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:42.217336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:42.217336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:42.217336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:42.217336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:42.218951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 238/490] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:42.220193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.220476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.220753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.254098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:42.256518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:42.340628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548decc4-5df8-4f4d-81a9-de63001abd00 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.357533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.382700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 239/491] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:42.383647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.402175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.403243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.403717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.404261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.419986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.421925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:42.471850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:42.472770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:42.473564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:42.473564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:42.473564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:42.473564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:42.479871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 253/492] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:42.481140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.509080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.518377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524972-7e07-424e-aa4a-d47d48b9e6f9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.560119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.561158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.561918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.562385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.563598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:42.564199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.566029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.587860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 240/493] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:42.589491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.644784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e6f9-a279-4ea8-b9af-73525f0abda0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.678698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.679368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.679651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.679931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.690982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:42.696044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1fb8-adc2-46dc-a23c-56eb3711da26 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b618c979-a700-4f94-83c8-403d77b6f27c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:42.696318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:42.697823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:42.698673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:42.702951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 254/494] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:42.704247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304b04-1ec8-4267-99a9-be6bbda00009 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.704537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304b04-1ec8-4267-99a9-be6bbda00009 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.704816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304b04-1ec8-4267-99a9-be6bbda00009 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.706217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 255/495] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:42.706802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304b04-1ec8-4267-99a9-be6bbda00009 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.735157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.742271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.742944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.743281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.743505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.744720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:42.745032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.746404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.759281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 241/496] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:42.760734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.776753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:42.819262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304b04-1ec8-4267-99a9-be6bbda00009 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.852511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.853147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.853946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.854224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.861601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.863067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.870576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6e408-a8ba-4cfe-b31c-0516d02d19d6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cc20ba08-e82c-45f2-bce4-4bdc426052ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:42.875833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:42.876697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:42.877549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 256/497] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:42.878127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503de76-3c5e-42f3-b816-3aeb01b3105c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.878406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503de76-3c5e-42f3-b816-3aeb01b3105c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.878764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503de76-3c5e-42f3-b816-3aeb01b3105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.896404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e503de76-3c5e-42f3-b816-3aeb01b3105c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:42.897590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e503de76-3c5e-42f3-b816-3aeb01b3105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:42.909370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:42.909995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.910281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.910603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.911318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:42.911628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:42.913022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:42.921639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 242/498] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:42.922670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.969010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 257/499] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:42.970288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71842d01-2a2f-4af0-9268-73bb85d676d1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:42.970620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71842d01-2a2f-4af0-9268-73bb85d676d1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:42.970896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71842d01-2a2f-4af0-9268-73bb85d676d1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:42.972128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 258/500] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:42.972821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71842d01-2a2f-4af0-9268-73bb85d676d1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:42.992553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.005329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.038216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577700-db99-44d3-bede-d10ba083bb78 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.072973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.073867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.074158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.074458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.077238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71842d01-2a2f-4af0-9268-73bb85d676d1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.082171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.083690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:43.096907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:43.097970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:43.098902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 243/501] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:43.099450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.114385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.115041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.115317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.115592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.116379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:43.116685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.118129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d82385-f190-4ccc-9631-3340b8d6227c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.155461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 259/502] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:43.156629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.156917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.157199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.175680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:43.176884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:43.205662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88c36-24c7-46d1-b724-2abd945203a3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.235669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.241424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.242070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.242354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.242660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.243417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 260/503] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:43.244289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.247419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.269617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.271134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:43.286404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:43.287480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 244/504] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:43.288388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.346898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648e3e8-629d-47da-a775-2e8553380c6d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.381542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.382200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.382516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.382799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.394476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:43.399483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:43.400904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:43.401653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:43.402364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7612e1-ad69-4279-ae6a-84cd6a415a4a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.402478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 261/505] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:43.402478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.439180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.439729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.440020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.440303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.441108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:43.441415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.442905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.466476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.484770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 245/506] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:43.486783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.514214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd71c6-6231-4e45-b147-1bf11307e620 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.536032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.554372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.555040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.557547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.557547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.607095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304c6c-72e0-401e-900b-a4513df7e7ca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.627979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.629469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.642216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.642919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.643209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.643722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.655002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.656495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:43.671389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:43.672265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:43.673092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:43.673092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:43.673092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:43.673092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:43.673092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 246/507] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:43.673342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.697060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.740027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 262/508] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:43.740717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.776072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.786010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6a04c-e232-4d5c-8362-14f9358b812c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.823062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.823688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.823975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.824253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.824949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:43.825264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.826676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.842187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 247/509] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:43.842394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076fad8-2143-4357-b557-76d3696a9d4d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.843054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.881510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.882139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.882427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.882743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:43.883464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:43.883777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:43.885774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:43.894496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 263/510] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:43.895318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:43.924285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:43.949983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736831fa-8d9c-4c6d-b726-d35c5fd79b53 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:43.984751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:43.985380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:43.985667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:43.985953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.006830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f7a36-0df2-4eba-8201-a2efa98caef7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.012032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.042840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.043624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.043910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.044192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.044893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:44.045206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.046606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.057932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.059435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 264/511] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:44.059566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.060290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.163231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.179994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead184f4-5afc-4a4c-aeb0-9c63a280761c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.182179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 248/512] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:44.183051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.220979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.221610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.221897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.222196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.232995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.234496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.241211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:44.250297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:44.251461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 265/513] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:44.252327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.288203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a127-4148-4473-badb-f8d45225c778 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.324170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.325608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.325901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.326214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.334057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.335571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:44.347636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:44.348668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 249/514] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:44.349575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.361819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c2c-56af-463e-be12-44f093dd9618 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.400776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.401426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.401717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.401997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.409242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.414042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.415560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:44.430711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:44.432544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 266/515] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:44.433662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.468334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac407e-2df4-47e9-b59b-f57bae5ffe5e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.485625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.508795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802587b0-33da-4fed-891e-8677447db462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.509422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802587b0-33da-4fed-891e-8677447db462 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.509741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802587b0-33da-4fed-891e-8677447db462 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.510022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802587b0-33da-4fed-891e-8677447db462 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.510781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802587b0-33da-4fed-891e-8677447db462 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.512471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802587b0-33da-4fed-891e-8677447db462 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.534853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 250/516] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:57:44 2022] POST /identity/v3/users => generated 247 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:57:44.535692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802587b0-33da-4fed-891e-8677447db462 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.543751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d137b5-eb83-4bb3-864c-10c204f807dc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.583217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.584017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.584402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.584808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.598200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.599925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:44.620175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:44.621258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:44.622289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:44.622289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:44.622289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:44.622289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:44.622289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 267/517] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:44.622795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.675102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.693124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802587b0-33da-4fed-891e-8677447db462 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.738909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.740089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.740089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.740089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.741025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:44.741374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.742969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.745298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808661b-d44a-4adc-bcfd-0a5c4e16ad89 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.758002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 251/518] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:44.759302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.794037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.795724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.796348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.796943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.797382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.798196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:44.798558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.801335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.826310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 268/519] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:44.826310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.883049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a352-b400-4eb8-8694-2a2ea17604b9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.920427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.921054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.921336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.921613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.922300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:44.922636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.924022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:44.934895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:44.936382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 252/520] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:44.937220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:44.943949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafed0d-7be8-4f6f-a6b9-5df6ae9c7636 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:44.980616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:44.981236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:44.981519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:44.981792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:44.982507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:44.982815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:44.984190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.000544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 269/521] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:45.000544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.038782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.051651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea99e1-6d75-4906-b8b0-c2480a032160 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.088914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.089578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.089864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.090139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.097840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.099348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.108744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c1f2-82c7-440f-a092-2d090189e5d2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:45.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:45.112623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:45.113673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:45.117636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 253/522] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:45.118598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.149709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.150879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.151170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.151446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.181237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.225706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.227204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.231410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b408a55-7448-4496-b8f0-be982c0426ca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.268427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.269031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.269260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.269542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.278635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.280112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:45.292359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:45.293855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 254/523] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:45.295076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.309428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.340393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 270/524] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:45.341261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.413106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.418557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb5ca-23cb-41a1-a243-f45cf0134632 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.452851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.453378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.453738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.454010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.458050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620744d-1979-4806-832f-91ce3ac795be None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.461146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.462657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:45.474200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:45.475249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 255/525] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:45.481274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.502807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.503433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.503720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.504002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.504752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:45.505086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.506528 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.525159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 271/526] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:45.525947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.554980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.588104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddef04-7b58-41cf-a3cb-4737e47de4ff None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.622596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.623350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.623631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.623941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.624815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:45.625132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.626716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.633002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f5a6-5bc5-4803-a6be-18f960d4be8e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.650801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 256/527] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:45.651830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.654100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.670767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.671422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.671710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.671995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.682984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.684450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:45.700644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:45.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:45.702412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:45.702412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:45.702412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:45.702412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:45.702412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 272/528] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:45.703018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.767271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca96f-0810-4d2a-85ff-a80fa755255c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.795885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.804587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.805220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.805513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.805797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.807134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:45.807463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.808925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.820840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13dc2-bba8-49ff-a28d-3ec14176cf21 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:45.826399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 257/529] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:45.827259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.860081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:45.861023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:45.861494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:45.861853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:45.862726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=07fbf4cc412649fba94ad020f6221b17) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:45.863050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:45.864493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:45.882472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 273/530] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/role_assignments?user.id=07fbf4cc412649fba94ad020f6221b17&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:45.882472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:45.950842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:45.956169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2498a-8ae6-4a41-8c41-5af5586e5859 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.008430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.009122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435e63d-ee29-41d5-bac5-cbd2beda66f4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.009340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.009772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.010154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.052810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.053360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.053640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.053914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.054639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:46.054948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.056354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.074347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 274/531] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:46.075330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.097123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:46.111952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.113473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.188767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:46.200383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae089-901f-488d-8708-30c1ee8af38a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.232855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 258/532] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:46.232855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.245989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.247081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.247667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.248200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.249262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:46.249788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.251705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.258732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 275/533] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:46.259957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.355017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:46.375804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1b121-1795-4b5c-af31-5b01090b1faf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.386722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2131-4b9c-4400-aa5c-f8e7a4f255d3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.420351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.421411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.421927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.422430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.430882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.432900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.433631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.433919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.434200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.434419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.447575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:46.448554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:46.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:46.450172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:46.450588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.457464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 259/534] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:46.459590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:46.494470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:46.495386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:46.496214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:46.496214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:46.496214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:46.496214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:46.498775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 276/535] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:46.504757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.530358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:46.587110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dc268-a40c-4644-a026-256ef9e611eb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.635361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.635928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.636218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.636751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.638060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:46.638407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.640547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fe22-e9a5-4468-8b75-a17a4dc5b1af None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.657544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 260/536] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:46.659985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b760-2f86-4d31-b6ee-ac509bca1268 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.660285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b760-2f86-4d31-b6ee-ac509bca1268 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.660573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b760-2f86-4d31-b6ee-ac509bca1268 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.662906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 261/537] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:46.663836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b760-2f86-4d31-b6ee-ac509bca1268 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.673854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ced97-e866-468f-9bc2-c8e2c49d2bee None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.679067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:46.728071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.728739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.729185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.729472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.730283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:46.730631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.732037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894209-6060-4cb4-8418-8b12dc4e53f8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.746453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 277/538] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:46.747785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.748075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.748355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.768870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:46.770194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:46.788596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b760-2f86-4d31-b6ee-ac509bca1268 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:46.825864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:46.826517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:46.826812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:46.827095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:46.827892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=acea16a4c33b4d5e96889f5600c35666) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:46.828207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:46.829662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:46.835933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 262/539] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/role_assignments?user.id=acea16a4c33b4d5e96889f5600c35666&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:46.836822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.852870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 278/540] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:46.882671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:46.886173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:47.026337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:47.057260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560fe26-b613-4825-9d3a-76389714a7a2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.063630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a427a-51bd-4103-b8b9-c0b5cb86f6c9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.099936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.100983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.101481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.101970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.114435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:47.126642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:47.127578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:47.128353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 279/541] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:47.146589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:47.175531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.176262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.176555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.176839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.196376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.197945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:47.229780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:47.230725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:47.231568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:47.234156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 263/542] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:47.240146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:47.264710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:47.311626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50833-a552-4f02-9153-87bc41f7dd00 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.358493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.358493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.358493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.358493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.358888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:47.358888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.358888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.374098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 280/543] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:47.380031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:47.456336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ace2-fe33-497e-8e67-abe976b15473 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.510810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:47.522559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.523946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.524742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.525299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.526455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:47.527289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.529201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.553439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 264/544] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:47.561549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:47.607324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63b25-d113-4780-b75e-9706b095c748 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.635937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:47.650792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.651641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.651933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.652214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.672636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.674130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:47.707042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:47.707898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:47.708691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:47.708691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:47.708691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:47.708691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:47.708691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 281/545] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:47.715877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:47.753282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ac5-55df-4cc5-bf05-a8f545b5cedc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.819344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.819977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.820327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.820612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.821477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=a54a66e5b7c04048a1f881739e6b4ab7) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:47.821794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.824434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.836808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 265/546] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/role_assignments?user.id=a54a66e5b7c04048a1f881739e6b4ab7&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:47.890922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845422c4-487d-4b6a-82f9-9e395232a99a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:47.930522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:47.931888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:47.932197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:47.932476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:47.933196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:47.933508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:47.935045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85acb-8e34-4f5e-a879-4af0e83ab5dd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:47.952723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 282/547] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:47.959759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.038765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:48.070957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8200-1336-4c31-b270-9e9c9fd36484 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.071265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8200-1336-4c31-b270-9e9c9fd36484 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.071525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8200-1336-4c31-b270-9e9c9fd36484 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.073188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 283/548] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:48.078567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.078864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.079146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.088149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3b80-fd7e-4907-957e-55f1267f7c10 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:48.099312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:48.100699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:48.137079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:48.156008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:48.156672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.156960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.157243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.174482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:48.175967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:48.201593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 284/549] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:48.206663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:48.207704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:48.208577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 266/550] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:48.213615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.271583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.415618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c55fb7-9ac6-41d9-95a9-c31a377e23cd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:48.468316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa897a2-ca39-4e10-bebc-4b390a965a0e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:48.477008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:48.477647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.477930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.478206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.479097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:48.479410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:48.480893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:48.503129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 285/551] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:57:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:48.511698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.514820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:48.544073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:48.567178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:48.567852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.568143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.568421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.587218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:48.592827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:48.593980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:48.594850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:48.599758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 267/552] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:57:48.605531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.625398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5da00-7f99-4d4c-84a3-8c872b995544 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:48.681304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:48.682896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.683388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.683903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.780116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:48.781972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a8516-590d-4ce7-9259-e713cbb1b893 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:48.805537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bcfca-44f2-4588-9409-0424ba4248b1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:48.813167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:48.897272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 286/553] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:48.898152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:48.899050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.899462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.899874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.900842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:48.901153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:48.902669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8517b-75a1-4bbf-a42c-4bc759a24498 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:48.903531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16bca-fa06-4f23-a2b9-e8138c254e15 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.903932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16bca-fa06-4f23-a2b9-e8138c254e15 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.904383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16bca-fa06-4f23-a2b9-e8138c254e15 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.906188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 287/554] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:57:48.907035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf16bca-fa06-4f23-a2b9-e8138c254e15 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:48.916913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 268/555] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:48.918320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:48.918638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:48.918919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:48.937666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:48.938893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:48.969696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.010278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 269/556] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:49.011249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.022386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf16bca-fa06-4f23-a2b9-e8138c254e15 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.061785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.062924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.063476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.064028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.074811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.079369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.081998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:49.105761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.106733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.107588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:49.107588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:49.107588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.107588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:49.113294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 288/557] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.113294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.126425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b100c-bd8e-4470-9abf-5fbe502c3184 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.163292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.163972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.164253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.164531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.179129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.180596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:49.198660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.200065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.200923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:49.200923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:49.200923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.200923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:49.204470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 270/558] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.205282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.232025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.258988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc2b9d-7bd0-436d-8c6c-3115e55ec6ff None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.300477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.301151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.301430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.301711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.314033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:49.319342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.321069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 289/559] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.323560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.360921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fe5a-1e9c-4293-953a-272f36fdae47 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.393573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.402572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.403209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.403493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.403771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.404528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:49.404833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.406467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.425595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 271/560] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:49.426627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.476110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cd55-886e-4530-8586-ac838d480122 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.523249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.523913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.524350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.524350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.524645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.525748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:49.526412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.528079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.546910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 290/561] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:49.546910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.551262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89982f0c-6702-48b7-9dc1-c7ab75faf71d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.594349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.595115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.595246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.595528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.598769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:49.598769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.598769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813ac4-d07e-4026-a5b1-a0d7285e5683 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 272/562] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b27e8-3ef3-4848-8f26-bc2976fa35de None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b27e8-3ef3-4848-8f26-bc2976fa35de None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b27e8-3ef3-4848-8f26-bc2976fa35de None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 273/563] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:49.611748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b27e8-3ef3-4848-8f26-bc2976fa35de None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.667609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.675510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e37b5a-39b9-4e61-9186-e8e819e6d62f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.716583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.717256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.717542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.717821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.725111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.726608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.731483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b27e8-3ef3-4848-8f26-bc2976fa35de None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:49.740480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.741635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:49.742642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 291/564] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.743112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.776988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.777833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.778190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.778566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.788857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.791579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-42481852-c112-4a03-844f-b5b331ee37f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:49.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.807664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 274/565] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.808574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.809216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.809216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.815911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:49.829404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:49.831576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:49.874844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ba8b-6aec-4abe-9628-ce9f6ff17f92 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:49.910905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 275/566] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:49.911765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.920325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:49.921705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:49.922914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:49.927371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:49.946006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:49.948517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:49.964370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:49.965488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 292/567] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:49.966648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:49.983901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.041523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282d383-ddbb-42fc-8149-6afb5a06fa1c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.071369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.077035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.077670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.077961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.078237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.079025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.079341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.080788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.084144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760b06-b50a-488c-85bb-580408f48bd6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.093132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 276/568] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.094016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.124548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.125235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.125466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.125760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.126592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.126911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.128362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.145980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 293/569] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.146972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.197385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f390b-3a77-458d-a544-0b5b213b360a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.214117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.231780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.232423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.232705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.232979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.243136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c7869d56-33b2-471d-b94f-d8f7f1e1e2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:50.248466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:50.249537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:50.250699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:50.251485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95768-ae86-4c20-8d7a-9eeb1d6816ab None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.251579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 277/570] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:50.251579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31ec9-f668-46f0-a55c-244dfff74e12 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.251579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31ec9-f668-46f0-a55c-244dfff74e12 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.251579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31ec9-f668-46f0-a55c-244dfff74e12 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.252697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 278/571] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:50.253391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec31ec9-f668-46f0-a55c-244dfff74e12 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.289500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.290601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.291668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.292177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.293271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.293584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.295021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.307716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 294/572] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.308555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.310321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.363721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec31ec9-f668-46f0-a55c-244dfff74e12 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.398091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.398662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.398953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.399236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.400027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=d55ffdc3893f45e0881043a7b10857b6) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.400992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.402455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.407864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 279/573] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/role_assignments?user.id=d55ffdc3893f45e0881043a7b10857b6&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.408644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.413248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0ddc9-6d23-469f-9880-13daa5f23f9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.442657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.455635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.456318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.457228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.457518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.475609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.477153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-89e905e3-4e17-465e-8127-55c85f256a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:50.493141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:50.494180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 295/574] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:50.495885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.496218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.496218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.515550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:50.516808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:50.539837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e89e82-ee18-41be-a179-27e3ba74b279 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.559021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.581507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.582176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.582467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.582757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.583481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.584096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.589044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.602463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 280/575] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.602463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.603096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 296/576] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:50.604752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.718837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425a9d8-ddd4-41a9-9e5b-758ed44d6dc3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.719204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c954f-5a1a-4aa5-88d9-8fbf467c1d87 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.729267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.756252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.756882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.757172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.757453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.758029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.758157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:50.758488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.758701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.758989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.759265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.760468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.768311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.769764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.777514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 297/577] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:50.777514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:50.781814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:50.782874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 281/578] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:50.783812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.828235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:50.891157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e472-c7ff-4af5-8d5d-0e353fdb217b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.899932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147760-dbe8-463e-9793-18dee4c072dd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:50.925904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.926597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.926889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.927173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.939871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:50.940081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:50.940703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:50.940987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:50.941267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:50.945475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:50.946403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 282/579] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:50.953526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:50.957244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:50.958635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:50.973909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:50.974842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:50.975731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:50.975731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:50.975731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:50.975731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:50.979804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 298/580] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:50.980669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.006411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.062780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.067557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c246bd-5b28-43fb-b175-7ebd5dbd5e2a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.091177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac238710-72d8-431f-bcd0-deb8e6dcf8ab None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.104749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.105401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.105687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.105965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.112872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.114324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:51.126486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:51.127375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:51.128230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:51.130340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.131007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.131292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.131570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.132404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 283/581] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:51.132671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:51.132990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.133176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.134707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.157717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 299/582] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:57:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:51.157717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.237035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.247499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42088a8-55b5-4ef6-89be-25f746352416 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.261767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5a83-2537-456a-9d6f-5dfba2b3530e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.286926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.287551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.287933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.288121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.288838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:51.289213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.290590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.299622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 284/583] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:51.300911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.301533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.301804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.302079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.302796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:51.303102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.304455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.304886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.317509 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 300/584] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:51.318413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.334191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.422412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a7d6-4f2a-43a9-81bb-15a7de302460 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.427409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20656c-7fab-47d2-a6f7-00d6655fe296 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.459638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.460268 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.460585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.460816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.461562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:51.461875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.463890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.464892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.465601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.465893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.466172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.474568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.478131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 285/585] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:51.479868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.484933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.486535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:51.502013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:51.503036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 301/586] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:51.504535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.577607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.600066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19d1e-ab69-4ead-bd9a-ef0db5e61786 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.610833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c4ec7-5003-4400-b232-bb5a3c707e06 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.646185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.646863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.647147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.647424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.649070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.649721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.650566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.650994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.658697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.658948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.660164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.660388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:51.672508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:51.673454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 302/587] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:51.675075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:51.681780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:51.682899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:51.683757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:51.683757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:51.683757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:51.683757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:51.683757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 286/588] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:51.684306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.738723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.788945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6bfad-548e-42ab-88b8-1bd18ddc5999 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.800733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80e2d-ffdb-4fc6-a938-7088fea4aa11 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:51.820677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:51.826752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.827392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.827686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.827971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.828669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:51.828987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.830382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.838844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:51.839533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:51.839820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:51.840103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/07fbf4cc412649fba94ad020f6221b17/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:51.848474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 287/589] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:51.848474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.865506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=07fbf4cc412649fba94ad020f6221b17, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:51.867519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:51.881787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 303/590] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:51 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/07fbf4cc412649fba94ad020f6221b17/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:51.895436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:51.981354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f7a1-e32d-4df0-aba3-5eb5ee43f20f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.022031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.022853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.023092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.023376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.024257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:52.024570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.026748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.027479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.031933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ae04-b7a4-4cdb-a446-1a1ea6ae490a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.048027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 288/591] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:52.048901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.073996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.075047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.075538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.076018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.076903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:52.077396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.079013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.093388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 304/592] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:52.094392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.121505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.189307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0d53-36ae-453c-9590-4e6cee0eae48 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.238372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292497-c814-4f70-b682-b84e18dfe4a6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.242025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.242423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.242734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.243016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.255753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.258410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:52.276329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:52.277217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:52.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:52.284976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 289/593] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:52.284976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.291593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.292308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.292659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.292944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.307544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.309346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:52.331024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:52.331965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:52.332869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:52.332869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:52.332869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:52.332869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:52.334518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 305/594] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:52.335625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.353017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.415888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcedc2-439b-4b6a-bd6c-23c7cf572206 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.427939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.453642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e2ed-56f1-4cfa-b077-98ddb7bcc3d2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.457043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.457558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.457846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.458128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.466120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.467621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:52.480666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:52.481672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:52.482639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:52.486414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 290/595] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:52.487323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.505057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.506000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.506358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.506695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.507459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:52.507775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.509236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c62966-9f36-4ab7-8c57-bfd44887bd72 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.523135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 306/596] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:52.524383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493baa2d-f025-4e0e-ad9e-fd61dbe7202b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.524667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493baa2d-f025-4e0e-ad9e-fd61dbe7202b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.524942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493baa2d-f025-4e0e-ad9e-fd61dbe7202b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.526421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 307/597] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:52.530892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493baa2d-f025-4e0e-ad9e-fd61dbe7202b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.613608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.617156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226dc8f-dea7-433d-a772-5bae15781647 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.649936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493baa2d-f025-4e0e-ad9e-fd61dbe7202b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.656566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.657367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.657659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.658319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.658676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:52.658991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.660582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.685808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 291/598] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:52.686920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.689752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.690327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.690670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.690912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.691716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:52.692035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.693506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48963e5-c25b-43f0-b10f-0d16206b9852 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.714922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 308/599] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:52.716021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.716308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.716662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.725709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.736823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:52.738037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:52.805711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241d999-8a32-4e52-a58c-f9a8cb5559eb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:52.811873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 309/600] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:52.813327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.855312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:52.855995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:52.856282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:52.856561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:52.872910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=1231588fdfd54ace81dc7b2f35ec6f8a, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:52.874359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:52.877913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:52.890302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 292/601] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:52 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:52.891399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:52.942689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bbe6e-bfd0-431b-8535-4f2fcd49f41e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.001251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.002133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.002555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.002932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.015729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.018072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.019433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:53.044714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:53.045640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 310/602] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:53.046574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.053565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cedb9-48bc-4afe-9b2b-b2696535e669 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.105226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.105842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.106122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.106387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.118396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.120204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:53.135849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:53.137031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:53.137888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:53.137888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:53.137888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:53.137888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:53.137888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 293/603] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:53.138160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.182119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1ae8-9ae3-49a4-abe7-0f0b11333310 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.205376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.227892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.229131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.229423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.229707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.242645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:53.248347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:53.249516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 311/604] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:53.250428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.303207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49476a4-81aa-4d7c-8bbd-6a9ace70db6c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.336935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.344619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.345584 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.346076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.346636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.347604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:53.348121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.349777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.368535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 294/605] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:53.370014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.388900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd9e9-2407-4ddc-9797-2b617b722992 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.433635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.434265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.434572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.434851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.435717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:53.436030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.438012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.455020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 312/606] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:53.455885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.496005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eae41-8a98-4c13-b44e-81638cf197db None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.542083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.546053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.547358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.548034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.548521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.550276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:53.550842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.553190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.564804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 295/607] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:53.565965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.598983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c7e4-a8c0-4965-ae8f-143b63578c58 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.641284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.648041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.648874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.649162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.649446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/acea16a4c33b4d5e96889f5600c35666/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.673567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=acea16a4c33b4d5e96889f5600c35666, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.675406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.706474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 313/608] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:53 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/acea16a4c33b4d5e96889f5600c35666/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:53.706474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.707636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df135e58-5780-4d4f-a04e-e730a5b32aa8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.772634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.773843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.774385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.774946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.791791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.793681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:53.816648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:53.817711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:53.818656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:53.822955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 296/609] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:53.827756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:53.836279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925548b2-472e-4d43-9cf4-89a52c56cbc2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:53.880824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:53.882030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:53.882603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:53.883333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:53.899248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:53.902285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:53.920447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:53.921380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:53.922230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:53.922230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:53.922230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:53.922230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:53.924806 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 314/610] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:53.930156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.054073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf697-b8ca-41db-976c-491e93d593c9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.065455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6717-69f8-42e2-8cad-e7088c7262f7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.070627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.092384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.093005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.093291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.093567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.094319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:54.094662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.096101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f65c3-6878-4da6-b468-b3e92a78c009 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.101511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.102198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.102518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.102806 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.104043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:54.104356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.105721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab093-76b7-439a-b9a0-0a965c30ab66 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.109957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 297/611] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:54.111270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7878b2-c235-47f6-9c4f-d1bf928619cf None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.111618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7878b2-c235-47f6-9c4f-d1bf928619cf None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.111956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7878b2-c235-47f6-9c4f-d1bf928619cf None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.113435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 298/612] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:54.118166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7878b2-c235-47f6-9c4f-d1bf928619cf None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.119416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 315/613] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:54.120696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.120991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.121276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.128830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.145839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:54.147133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:54.238014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7878b2-c235-47f6-9c4f-d1bf928619cf None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.242174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 316/614] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:54.243149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.305132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.305816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.306112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.307257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/a54a66e5b7c04048a1f881739e6b4ab7/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.329953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=a54a66e5b7c04048a1f881739e6b4ab7, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.332080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.349125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 299/615] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:54 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/a54a66e5b7c04048a1f881739e6b4ab7/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:54.350302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.363171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd8cc2-0a1a-49af-8261-e84c63fbea26 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.389855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.405569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.412950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.413788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.414140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.414552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.424119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.425812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:54.441211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:54.442225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:54.443535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 317/616] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:54.448886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.492934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6df0f-cc35-48ef-9cd8-5d1570d0a3d4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.538329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.539029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.539321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.539602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.555345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:54.561881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:54.562931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:54.563740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 300/617] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:54.569240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.656643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7532-629f-44fd-bd9a-2342776ed126 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.678833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.688474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f3dd-10a2-47c3-8104-a667d0b369d9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.727596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.729077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.729436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.729730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.730478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:54.730818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.732793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.742526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 301/618] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:54.752156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.759812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:54.760790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:54.761239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:54.766860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:54.767867 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:54.768333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:54.770191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:54.807409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 318/619] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:57:54.811769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:54.903225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:54.948457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f497f-928b-4592-b622-91aa9843ada7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:54.992129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5185d2-1381-4dd9-9772-6d48f3380880 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.014936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.015909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.016403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.016905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.031163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.033068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.043600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:55.049765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:55.050684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:55.051549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:55.051549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:55.051549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:55.051549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:55.055091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 302/620] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:55.061130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.073071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.073842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.074135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.074419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.091641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.093193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:55.118714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:55.119666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:55.120964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:55.120964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:55.120964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:55.120964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:55.120964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 319/621] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:55.126872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.243016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c86bb-992e-457d-9946-f26a5bda3be4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.288952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.289857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.290134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.290412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.291182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:55.291493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.292877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461157e-650f-435e-b00a-2f1d87289343 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.315601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186872f-9cbf-4270-a9af-8bfc0ff639b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.316166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 303/622] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:55.317452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:55.320019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254228e-bcd4-419c-a755-0a1c87b82efe None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.320542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254228e-bcd4-419c-a755-0a1c87b82efe None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.321044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254228e-bcd4-419c-a755-0a1c87b82efe None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.323841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 304/623] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:55.324830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254228e-bcd4-419c-a755-0a1c87b82efe None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.359945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.360802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.361308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.361592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.362360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:55.362746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.364235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16237b49-cc20-4bc4-993e-a79fc0087dce None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.388222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 320/624] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:55.388222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.388222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.388222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.408756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:55.410121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:55.414678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:55.473905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254228e-bcd4-419c-a755-0a1c87b82efe None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.510116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 321/625] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:55.511357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.543464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.544545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.545112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.545619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.564781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.566412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:55.580973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:55.581968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:55.582915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 305/626] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:55.583490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.639423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:55.649499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838423b-a4a6-41cc-9259-1ffb8fcaa30c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.695400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.696711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.697213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.697696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.708357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.710018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.721226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffb3f-ebed-43bf-8f6f-7f46f365a641 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:55.738930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:55.740696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:55.742287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:55.745011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 322/627] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:55.745997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.752159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:55.774237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.775605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.775965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.776249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.788309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:55.794192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:55.796206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:55.797931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:55.800370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 306/628] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:55.801133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.907223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358bd6-5adc-4e33-8306-70d2810dcfa5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.945380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede1b62-79e3-4aa2-94ef-b97baaa64beb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:55.956551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.957902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.958374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.959248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.960521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:55.960985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.962871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:55.990067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:55.991050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:55.991478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:55.991895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:55.992131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 323/629] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:55.993065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:55.993179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:55.994257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:55.995981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.007804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.024540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 307/630] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:56.025662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.074672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.120348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad3ee-4735-454a-b3b9-590de400d684 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.144681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f1bdf-a3c4-4028-9753-35d76674c528 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.159281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.160416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.160940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.161215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.162040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:56.162353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.164187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.177795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 324/631] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:56.177795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.188871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.189421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.189705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.189982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.257514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.272034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.273672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187cc42-a4a0-477e-a8b1-b2bd4c399e52 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.295623 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32fcff-1f04-4930-b093-527bba9efdde None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.318257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.334435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.335080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.335376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.335712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/d55ffdc3893f45e0881043a7b10857b6/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.351516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=d55ffdc3893f45e0881043a7b10857b6, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.352969 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779160f1-cc0f-43ff-8c20-df973d4af4e5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.373053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 325/632] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:57:56 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/d55ffdc3893f45e0881043a7b10857b6/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:57:56.374523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c4643-3d9b-4f3b-8ced-27e370e2bc66 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.374818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c4643-3d9b-4f3b-8ced-27e370e2bc66 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.375098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c4643-3d9b-4f3b-8ced-27e370e2bc66 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.378562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 326/633] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:56.378562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c4643-3d9b-4f3b-8ced-27e370e2bc66 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.426496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 308/634] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:56.428528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.430006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.430535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.457219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:56.460031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:56.511167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c4643-3d9b-4f3b-8ced-27e370e2bc66 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.537996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.553473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.554132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.554418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.554731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.574488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 309/635] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:56.574488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.576255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.578407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b72863f6-a1ab-4bc8-8322-2ebb44685e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:56.600270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:56.601187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:56.602051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:56.602051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:56.602051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:56.602051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:56.602267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 327/636] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:56.605190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792930-6671-42a1-968e-41dc880c73ba None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.605478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792930-6671-42a1-968e-41dc880c73ba None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.605759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792930-6671-42a1-968e-41dc880c73ba None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.610669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 328/637] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:56.612076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792930-6671-42a1-968e-41dc880c73ba None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.658303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.696854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713c80-b24a-4441-a0f4-ba581a65b755 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.734143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.734836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.735125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.735374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.736649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792930-6671-42a1-968e-41dc880c73ba None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.747086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.748549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:56.764616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:56.765571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 310/638] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:56.766881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.778780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.779433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.779721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.780002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.791675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-eb646695-156f-4155-bdbc-03d33a07c493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:56.797103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:56.798218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:56.799469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:56.802593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 329/639] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:56.807550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.807843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.808122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.827505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:56.828710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:56.871240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.912738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb265-eb5c-47cb-8a55-ba93d9694632 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:56.934475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 330/640] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:56.934475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:56.949798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:56.972789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:56.973467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:56.973747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:56.974026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:56.974761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:56.975077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:56.976516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:56.994277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 311/641] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:56.994277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.051430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc5d02-9793-4a3c-befc-d1ffa9f0f77f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.092385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.093049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.093342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.093626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.094326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.094664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.096050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.102410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535642-8a09-42cd-a427-0a093ee5668c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.108121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 331/642] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.108962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.137807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.146222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.146887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.147173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.147460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.148182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.148490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.149896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.159394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 312/643] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.160040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.205675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.225959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee419-7bb4-45fa-a5d1-b958d4493ce4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.262949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.263838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.264271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.264682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5e8d1-8b54-4bd1-b8ba-a755e416bb27 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.264885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.278348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:57.284515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:57.285678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:57.286693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:57.289202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 332/644] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:57.290303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.306416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.307103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.307393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.312484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.321335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.324164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:57.342221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:57.343515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:57.344705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 313/645] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:57.345334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.397053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.416509 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f514c-3856-47b4-89eb-ee3fd5f09b2c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.454205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.454952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.455155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.455441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.459947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332f7e-9d02-4d7f-b7e8-8ecda745499c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.461740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.463266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.464601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:57.476407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:57.477307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:57.478238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:57.485000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 333/646] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:57.485000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.510014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.510687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.510971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.511244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.523442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.525199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:57.540632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:57.550909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 314/647] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:57.552980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.607518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae264c-d878-4c47-b50b-0122adcc31a6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.653356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.654150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.654261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.654563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.655280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.655596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.656963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.670366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 334/648] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.670366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.674913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f50ca-4b0c-4a02-87bc-34a06bbb0b29 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.679774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.713078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.714188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.714466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.714767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.715950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.716271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.718089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.738497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 315/649] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.739360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.755433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.786144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b0eff-7c35-4274-95a5-bae5ab6059c4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.823490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.824116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.824403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.824684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.825434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.825746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.827217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.839986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 335/650] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.842006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.854087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c1-1e69-4de9-b6d4-dd7f66738121 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.891642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:57.892432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:57.892717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:57.892997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:57.893687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:57.894061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:57.895488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:57.911914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 316/651] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:57.911914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:57.922821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:57.962016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfade4-cf31-4544-a152-243d7f073447 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:57.988703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.002771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.003944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.004229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.004514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.022048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.024430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.031156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19296c7-0ff2-4ef5-a71e-655f4e31f3de None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:58.042825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:58.043944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:58.044987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:58.044987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:58.044987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:58.044987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:58.044987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 336/652] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:58.045274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.075644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.076544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.077008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.077290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.154707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.156190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.156431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077f77-381f-4d1b-9533-659d09c71d9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.174707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.194079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.194736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.195021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.195302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.196086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=07fbf4cc412649fba94ad020f6221b17) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:58.196397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.197913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.214356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 337/653] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/role_assignments?user.id=07fbf4cc412649fba94ad020f6221b17&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:58.214356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.249023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.286472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 317/654] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:58.287526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.359327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df59a6-a642-43f0-a30b-ad944f102a0a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.409699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.410355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.410690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.410967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.421656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.423797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.426478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bfc5d-f466-4eb2-a896-3687b307ba5b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:58.437517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:58.438508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:58.439442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 338/655] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:58.440030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.483768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.484793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.485086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.485505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.486216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:58.486562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.489137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.503123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.504801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 318/656] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:58.505670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.552643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.581448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed26d5-ab01-4508-be53-cdef260ae566 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.630287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.632034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.632854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.633347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.646033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cce72-be70-4c7e-981e-8073d4ccdd9a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.651746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.653204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:58.669572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:58.670538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:58.671400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:58.671400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:58.671400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:58.671400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:58.671400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 339/657] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:58.671674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.687834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.688392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.688669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.688946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.689737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:58.690104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.691541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9234be-0c7c-45c4-a192-98de612bb95c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 319/658] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28649-ff85-4077-9380-f8c17eca37dd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28649-ff85-4077-9380-f8c17eca37dd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28649-ff85-4077-9380-f8c17eca37dd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 320/659] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:57:58.716327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28649-ff85-4077-9380-f8c17eca37dd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.783648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.791004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469e8c-5f42-4756-be92-d1ad0d400e2c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.815395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:58.827582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28649-ff85-4077-9380-f8c17eca37dd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.827749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.828278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.828627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.828914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.837006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.839193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:57:58.851536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:58.852495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:58.853454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 340/660] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:58.854051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:58.870142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:58.870802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.871086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.871359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.872052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:58.872358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:58.873733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643985e-f833-425b-8280-c6d3486a072e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:58.887299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 321/661] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:58.888590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:58.889157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:58.889157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:58.908481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:57:58.909838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:57:58.985535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8779-32df-439f-840b-d02ae225dd18 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:58.988352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 322/662] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:57:58.989485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.033460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.034478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.034478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.034735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.061830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.081580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.107699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9e0ae-ff75-48da-b4eb-1e9280893b06 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.113221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.114741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.149687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.150322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.150660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.150973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.151777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:59.152085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.153551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.177934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 323/663] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:59.178755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.230467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 341/664] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:59.231319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.293901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.303414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57eb2d-b91d-4b05-a0f1-b7683b48ece7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.339219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.339856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.340136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.340413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.344648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcfb5-5819-4b3f-a166-1d8be49a8309 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.348289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.349778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.351939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:57:59.364925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:59.366027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 324/665] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:59.373919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.389015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.389948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.390325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.390740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.401424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:57:59.406779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:59.408055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:59.409282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 342/666] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:59.410120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.495941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-3277-4937-956c-65ecdb708d85 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.527811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32effeaf-b5b1-4087-87fe-679b343675de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.537143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.537766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.538048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.538321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.552829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.578552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.579219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.579574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.580015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.592290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.593898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:57:59.611317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:57:59.612269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:57:59.613133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:57:59.613133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:57:59.613133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:57:59.613133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:57:59.613133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 343/667] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:57:59.613421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.622941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.627302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.628894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.734046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe43e9-377a-4eaa-a116-e4e7e85e7ffd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.766115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 325/668] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:57:59.766945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.771221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.772071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.772340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.772573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.773323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:59.773628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.775592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.793908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 344/669] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:59.793908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.831181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.889478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:57:59.894736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab11dc-7965-4e15-b4b9-c9ca1af995e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.921917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079e80-4c89-4b70-a886-0af97e4c37f5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:57:59.937803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.939050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.939369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.939628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.940399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:59.940713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.942286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.952403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 326/670] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:59.953152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:57:59.968058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:57:59.968700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:57:59.968989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:57:59.969269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:57:59.969977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:57:59.970290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:57:59.971795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:57:59.990495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 345/671] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:57:59.990495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.081292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc212-348b-4f23-9c89-6c80a99dd659 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.088888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.110124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12bb8b-ffbe-43e8-ac34-e5b1e3809f9a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.116985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.117755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.118664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.119053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.130850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.132326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:00.147756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:00.148870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:00.150575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:00.150575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:00.150575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:00.150575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:00.150575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 327/672] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:00.150868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.156377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.158118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.158595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.159023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.160062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:00.160526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.162118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.168727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.182477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 346/673] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:57:59 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:00.182477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.279043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dde17-d5f3-433c-8d11-a40a8066aafd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.319094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.319758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.320051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.320332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.333459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.334892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.340329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94188f6-26b9-42dc-bd58-f28cd504e7a9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:00.353830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:00.355013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:00.355921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:00.355921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:00.355921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:00.355921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:00.357427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 328/674] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:00.358397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.385247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.386737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.387030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.387378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.396921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.398380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:00.412422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:00.413511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:00.414609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 347/675] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:00.415192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.429647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.440263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.491545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1a6ef-1ae0-4fe3-b0af-741434cfde71 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.530634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.531424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.531715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.531991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.532744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:00.533097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.534537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.545960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc7517-ddec-4a6f-844b-eae9e916f205 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.547147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 329/676] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:00.547813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.583763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.584351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.584652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.584852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.585540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:00.585844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.587381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ab404-c0b0-4b16-b0ef-ee55d7d99c0e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 348/677] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deba2e-0bb8-4621-81f7-46bee3da0c4f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deba2e-0bb8-4621-81f7-46bee3da0c4f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deba2e-0bb8-4621-81f7-46bee3da0c4f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 349/678] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:00.604385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deba2e-0bb8-4621-81f7-46bee3da0c4f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.663890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a209a-7f59-4cf8-8ee3-18c3e6798e8a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.679214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.690789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.703723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.704353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.704632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.704910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.705657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:00.705973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.707442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.714741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deba2e-0bb8-4621-81f7-46bee3da0c4f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.720030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 330/679] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:00.721001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.753758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.754414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.754728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.755009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.762644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.764111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0ddf2180-c617-498a-9437-eac26839c835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:00.776388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:00.777285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:00.778160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 350/680] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:00.778990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.778990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.779257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.798997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:00.800314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:00.840013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303048-588f-45fa-9bfc-fb7773619b4d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:00.870492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 351/681] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:00.870492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.890830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:00.892141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:00.892637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:00.893486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:00.904422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:00.906252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:00.919006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:00.919948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 331/682] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:00.920992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:00.939413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.972296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:00.984045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067eac4-3478-41bd-b6d2-fcf970356850 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.025218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.025891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.026137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.026406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.027224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=acea16a4c33b4d5e96889f5600c35666) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:01.027536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.029114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.046519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 352/683] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/role_assignments?user.id=acea16a4c33b4d5e96889f5600c35666&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:01.046519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.054552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05632-844f-4205-a218-d113b68b4494 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.095166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.095723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.096015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.096294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.097066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:01.097387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.098904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.119453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 332/684] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:01.120451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.183139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01933-51ac-4bd1-8695-164cdababd5a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.212977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:01.225897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.226584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.226874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.227153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.244875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.246424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.248641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cd167-f4b2-4d6c-96dc-63b9e61cd4e3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.252355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:01.265169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:01.266085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:01.266994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:01.266994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:01.266994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:01.266994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:01.270740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 353/685] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:01.271700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.297190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.297835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.298125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.298409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.300051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:01.300371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.301840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.321654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 333/686] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:01.322479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.411561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fb31d-54dc-4a74-91fa-f40677db985d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.438812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecad846-d0e2-4697-97bb-96ab9edc57e7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.460121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.461080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.461552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.461978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.463957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=a54a66e5b7c04048a1f881739e6b4ab7) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:01.464554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.466298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.478858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 354/687] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/role_assignments?user.id=a54a66e5b7c04048a1f881739e6b4ab7&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:01.479735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.486395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.488711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.489766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.491403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.494361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:01.494779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.498917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.526050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 334/688] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:01.530154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:01.573626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:01.585646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:01.697830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437571f-d90d-4ae8-9970-d3a550cc8bfe None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.715198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be5d8-64f7-4afb-96f9-93c940509252 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:01.741185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.741870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.742163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.742471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.763358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:01.764296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:01.764730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:01.765262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:01.766264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.767782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.798209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 335/689] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:58:01 2022] POST /identity/v3/users => generated 254 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:01.841261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:01.843207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:01.894820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:01.966007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 355/690] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:58:01.974508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:02.085048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:02.114828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2a6ed-be49-4282-a5ff-ae8a3cb74b50 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:02.154037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:02.155113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.155623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.156154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.168818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:02.170677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:02.186792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:02.187713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:02.188599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:02.188599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:02.188599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:02.188599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:02.190878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 336/691] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:02.196447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:02.314151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61806d-7ec9-456a-a962-a36d15c2411d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:02.358066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:02.358943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.359537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.359894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.360918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:02.361236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:02.362763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73391e-03b3-4f52-9de9-bfd0f775153d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:02.373232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:02.377212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 356/692] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:02.382719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:02.538718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dacd4-b9cf-4b80-9c45-e780e7f8bd85 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:02.579098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:02.580974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec969c-085f-4d37-9aee-82895f771a6c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.581426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec969c-085f-4d37-9aee-82895f771a6c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.582116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec969c-085f-4d37-9aee-82895f771a6c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.585275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 357/693] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:02.587315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:02.588431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.588721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.589002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.592409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.592871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.593294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.600933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:02.603435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:02.613787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:02.615284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:02.626525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:02.627648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:02.628630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 337/694] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:02.629200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:02.768130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 358/695] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:58:02.861043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753dc24-0c16-4db5-9e4f-2f3b5dc73d06 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:02.867897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:02.954065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:02.954752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:02.955042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:02.955548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:02.956330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:02.956647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:02.958117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:02.997024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 338/696] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:03.018158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.071182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e148-5d13-4a06-b786-7a70e4cba5e8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.105546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:03.119641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.120263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.120554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.120837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.142993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:03.147970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:03.148883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:03.149690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:03.154855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 359/697] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:03.157418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.161559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:03.277067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bed71f-3902-4b85-b3a3-7fc889b32390 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.284988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90a4b-2b2d-4a3d-971b-d370f137b59e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.329863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.330525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.330815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.331095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.331821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:03.332135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:03.333506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:03.355583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 360/698] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:03.361789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.363517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.364170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.364458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.364741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.365551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=d55ffdc3893f45e0881043a7b10857b6) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:03.365870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:03.367360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa8c5-cedd-401c-9621-becba7ef6a6a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:03.395053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 339/699] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/role_assignments?user.id=d55ffdc3893f45e0881043a7b10857b6&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:03.445815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874d887-9ebe-4d3f-9a63-99984c19e705 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.446150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874d887-9ebe-4d3f-9a63-99984c19e705 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.446378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874d887-9ebe-4d3f-9a63-99984c19e705 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.448786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 340/700] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:03.454330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.454650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.454946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.467517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:03.499741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:03.500970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:03.526379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb024a-1096-4e4c-a531-07f8c56e2f62 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.579487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.580155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.580433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.580710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.604828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:03.606328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:03.626180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 341/701] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:03.635498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:03.637815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:03.640034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:03.640034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:03.640034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:03.640034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:03.640034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 361/702] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:03.646554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.659971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.726558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:03.799722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a879-c7be-4a34-bb56-aac364c49068 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.808924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a54c5-c0d9-4761-bcff-ce69b4ea97cc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:03.812759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:03.840129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.840771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.841063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.841342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.842050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:03.842363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:03.843866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:03.858466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 342/703] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:03.859788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:03.860448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:03.860742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:03.861063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:03.861697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:03.863133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:03.863682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:03.878410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:03.879486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:03.881016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 362/704] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:03.885620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.020900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b1a1f-ea8f-4740-bbea-ca263ce39248 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.023757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.049044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb38ae3-ca6c-40d6-8d3a-9ee8312e548e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.086761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.087838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.088365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.088899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.089913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:04.090427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.092454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed45a5-6b02-4ed1-8840-38d57cdcceac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.094289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.095257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.095370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.095713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.099346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 363/705] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:04.100907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079cd-a484-4a18-956a-68569f361fcd None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.101371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079cd-a484-4a18-956a-68569f361fcd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.101829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079cd-a484-4a18-956a-68569f361fcd None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.104093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 364/706] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:04.105297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275079cd-a484-4a18-956a-68569f361fcd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.113273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.114886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9876eac4-d6d9-4745-ae80-7d5bcf87d046 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:04.128613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:04.129595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:04.131059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:04.134637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 343/707] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:04.136113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.136477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.137106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.145354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.160480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:04.162837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:04.229745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275079cd-a484-4a18-956a-68569f361fcd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.247470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 344/708] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:04.248375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.268698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.269615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.270006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.270429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.271392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:04.271793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.273322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.281159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 365/709] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:04.282326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.355157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.362260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3a24f-abe0-45dd-b7de-7a4f1382827b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.403091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.403743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.404027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.404557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.405144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:04.405462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.407010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b285e-8bdf-4063-bf7b-fbcdc9aa4b08 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.417075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.425102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a3ed-4805-4bc0-b1d2-1802f360e60b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.432423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 345/710] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:04.432423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26fc1-8e49-41d3-af1c-943327a71422 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.432423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26fc1-8e49-41d3-af1c-943327a71422 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.432423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26fc1-8e49-41d3-af1c-943327a71422 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.432423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 346/711] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:04.433462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26fc1-8e49-41d3-af1c-943327a71422 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.474302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.475319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.475754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.476178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] PATH_INFO: `/v3/services/network` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.476961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.479185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0e50df0c-3ce5-4d68-b24c-c6ffc75c5dfa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:04.490749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:04.491992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:04.492907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:04.495388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 366/712] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:04.496749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.497189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.497628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.518056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:04.519587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:04.563090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26fc1-8e49-41d3-af1c-943327a71422 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.605038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.605984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.606416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.606868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.610085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 367/713] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:04.612250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.631878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.701770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.703709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.722947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.734461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674bbf3-04f3-4128-be8e-2ee5e0148c37 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.770944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.771578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.771928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.772209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.772940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:04.773255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:04.774735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:04.784585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 368/714] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:04.785477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.833354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 347/715] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:58:04.834618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.897130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02636e-7acd-4174-bafe-621178c14095 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.910870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:04.937313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:04.937969 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:04.938312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:04.938719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:04.952299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:04.958648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:04.959566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:04.960385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:04.965010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 369/716] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:04.965953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:04.971310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e7949-710b-4266-a094-8655b6eedc64 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:04.986182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:05.019666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.020296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.020586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.020927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.021743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] RBAC: Adding query filter params (type=network) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:05.022343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.023877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.031088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 348/717] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:05.032341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.154911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d619a-4f39-4228-a6fe-cf88494e37c0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:05.235097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.235765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.236051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.236334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.249888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.251438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:05.269314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:05.271550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:05.273691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:05.273691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:05.273691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:05.273691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:05.273691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 370/718] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:05.278045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.359159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:05.408429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dc12-f452-48bb-b1cf-1580bda76ea1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:05.449345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.450151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.450418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.450727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.451946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:05.452383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.453964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.460441 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b633e-7ac9-4206-9532-18fe1097cf80 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:05.475634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 371/719] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:05.476971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.506249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:05.576025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.576664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.576946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.577222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.577941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:05.578247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.579671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.591278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffece-acf2-40c0-b432-1b40fbf92729 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:05.601748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 349/720] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:05.607709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.622843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:05.640388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.642469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.642469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.642469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.659781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.661367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:05.680759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:05.681769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:05.682659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:05.690886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 372/721] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:05.699879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.759781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b610199-12dc-41e4-8ff1-aebc5036406b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:05.806930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:05.807583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:05.807867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:05.808141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:05.820202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:05.821703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:05.839480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:05.840413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:05.841294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:05.841294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:05.841294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:05.841294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:05.841519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 350/722] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:05.846680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:05.910899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:05.940626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570083-13ab-4c90-9267-f41bb51e3379 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.015467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.016100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.016385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.016664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.017416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:06.017730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.019215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.049395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c758ec-1f87-4dac-9488-b55d6618b3ef None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.054043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 373/723] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:06.057154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.122306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:06.143020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.144208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.144702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.145214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.146142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:06.146783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.148478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059c29-87f1-4a41-83f9-40148cef992c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.175723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 351/724] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:06.177168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ff3a-b04d-4e55-a14d-c6e660d1a23f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.177585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ff3a-b04d-4e55-a14d-c6e660d1a23f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.177971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ff3a-b04d-4e55-a14d-c6e660d1a23f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.179821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 352/725] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:06.181657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20ff3a-b04d-4e55-a14d-c6e660d1a23f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.186471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3335d-4110-4463-9785-f926be01b69d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.222633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.223496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.224023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.224309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.225199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:06.225510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.227068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75535-651c-4a1d-ba35-32811d8e5137 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.238545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 374/726] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:06.241501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.242350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.243790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.273433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:06.275653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:06.355545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 375/727] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:06.390173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.390614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:06.413273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20ff3a-b04d-4e55-a14d-c6e660d1a23f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.444787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:06.490341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.499305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.499604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.499900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.510036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.511831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-805ff3de-3aef-476b-9d5b-300efc33d3a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:06.524338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:06.525398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:06.526349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:06.530453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 353/728] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:06.531866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4fbe-8750-4d4b-9c43-002e03dda178 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.532153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4fbe-8750-4d4b-9c43-002e03dda178 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.532430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4fbe-8750-4d4b-9c43-002e03dda178 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.533208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527ba5-0cd2-45db-a7e7-a80852ee2729 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.534080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 354/729] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:06.538882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4fbe-8750-4d4b-9c43-002e03dda178 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.579784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.581800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.582297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.582799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.601014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-03607464-a325-46a0-a906-bc2116510b72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:06.608565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:06.609537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:06.610358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:06.620171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 376/730] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:06.620171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.620171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.620171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.644901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:06.646091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:06.677888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4fbe-8750-4d4b-9c43-002e03dda178 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.718547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 377/731] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:06.719737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.735278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.736263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.736597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.736874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.737760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:06.738069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.739553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.766351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 355/732] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:06.767185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:06.769021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.781572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:06.852580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e121575-4a0e-455c-ad3a-285065e98628 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.890078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d057d-5190-44ce-8154-f12bd0fe93e2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:06.890821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.891825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.892400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.892869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.893778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:06.894327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.896104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.910420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 378/733] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:06.911729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:06.929384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:06.930024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:06.930307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:06.930613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:06.932298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:06.933975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:06.955192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 356/734] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:06 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:06.956597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.109990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.117121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.134030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b7f5-454d-4d36-9148-6f252aaee658 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.192052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdb85a-9dc0-4874-87af-6342a37ffcc0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.203074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.203748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.204245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.204422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.231514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.232560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.233054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.233531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.245116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.246908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:07.263231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:07.264154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:07.265094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:07.265094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:07.265094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:07.265094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:07.267335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 357/735] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:07.278790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.287626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.289124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.402578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.407251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f59e-451f-4bab-9e24-feb0c278b292 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.420290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 379/736] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:58:07.426912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.427332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.450063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.451084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.451545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.452012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.452735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:07.453273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.455072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.470488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 358/737] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:07.485615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.605871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690030d1-a0f8-47cb-beb8-e6c79657dc31 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.642890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb05e-5490-4001-a5ce-5baa1c456a6f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.646187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.647058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.647435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.647791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.668503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.670057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.688863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.689508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.689827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.690168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.699176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-eb3e84c4-7d26-4d03-ab6b-0a2e680c67b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:07.700208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:07.701055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:07.701916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:07.701916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:07.701916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:07.701916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:07.702132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.704553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 380/738] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:07.705562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158458-0127-4edb-be72-199160623182 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.705847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158458-0127-4edb-be72-199160623182 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.706124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158458-0127-4edb-be72-199160623182 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.707732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 381/739] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:07.714106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.714531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.714815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:07.719552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:07.720452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:07.721380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:07.724198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 359/740] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:07.725276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.737939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:07.739994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:07.782561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.790836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:07.855319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9478-8a05-4e44-9653-28c258d279cf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:07.897059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:07.897932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:07.898316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:07.898745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:07.899595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:07.900597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:07.902161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:07.921429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 360/741] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:07.921429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:07.958854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 382/742] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 11:58:07.960166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.051385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.060121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6374-8379-4912-9bf5-07a70404d5b0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.098824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2b42e-d0f9-4784-be3c-2fee5eafea2a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.112770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.113406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.113689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.113962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.114793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:08.115103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.117367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.145777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.146008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 361/743] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:08.146008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.147187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.147747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.148225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.156426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.158350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:08.171666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:08.172583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:08.173461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:08.180381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 383/744] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:08.182048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.215967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.275889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1643-de51-4d9d-b14a-9d11f201ba92 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.297685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6310e9c-aafd-415e-9d1a-46a874ecadb0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.323167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.323800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.324083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.324788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.325942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.327642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.338027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.338853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.339142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.339624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.350527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 362/745] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:08 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:08.351725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.371275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.483975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cbb0c-c69f-43b0-b6ca-807878768a3c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.489339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.492185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171ab6-b381-4046-afe9-4aa64b47657d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.525382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.526187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.526689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.527115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.528128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:08.528566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.530275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de123340-72e1-412c-bae9-63ba050d87c5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.535196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.550357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 363/746] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:08.552057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9903-b130-4f19-b6d9-766f3b0f9fb1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.552499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9903-b130-4f19-b6d9-766f3b0f9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.552909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9903-b130-4f19-b6d9-766f3b0f9fb1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.559302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 364/747] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:08.560628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9903-b130-4f19-b6d9-766f3b0f9fb1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.637779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 384/748] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 11:58:08.639271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.639457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.639740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.658227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.658591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:08.659718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:08.694349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9903-b130-4f19-b6d9-766f3b0f9fb1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.732083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.733094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.733563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.734034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.735033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=87701f1211364da59d0b76bbc737d102) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:08.735534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.737165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.741897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 385/749] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:08.743982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 365/750] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:08 2022] GET /identity/v3/role_assignments?user.id=87701f1211364da59d0b76bbc737d102&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:08.751689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.803554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:08.839163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:08.886078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e959f-6266-41c5-9226-d828a3251d5b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:08.926300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:08.928386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:08.929543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:08.930152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:08.956829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:08.959693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:08.989111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:08.990025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:08.990934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:08.990934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:08.990934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:08.990934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:08.994926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 386/751] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:08.999622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb078e-7375-4c28-a259-a316018e8e55 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.001277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.042740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.043538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.043899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.044584 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.050929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.060875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:09.066471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:09.067457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:09.068285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 366/752] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:09.074856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.188298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2993-b6b0-40f5-ac7d-fb17af1ce694 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.230468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.230468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.230468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.230468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.230892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:09.230892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.230892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.240967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 367/753] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:09.246901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.307209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1649-4c25-49e6-8bf8-c0553a84ff69 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.331809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.346933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.365761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.366841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.367334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.368391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.369304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:09.369870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.371907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71984b29-9645-4a9c-a5e3-cee757fd3cdd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.390253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 387/754] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:09.392446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101a805-2afb-4f71-bede-e59a4aaad028 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.393389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101a805-2afb-4f71-bede-e59a4aaad028 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.394251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101a805-2afb-4f71-bede-e59a4aaad028 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.400765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 388/755] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:09.400765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101a805-2afb-4f71-bede-e59a4aaad028 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.406003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b48a-0a68-4495-a10a-b9e71535eda0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.454265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.455628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.456551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.457076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.472828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.474895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-adc33117-c7e6-4df7-b492-9f4dd530ba4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:09.499232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:09.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:09.501082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:09.501082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:09.501082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:09.501082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:09.507944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 368/756] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:09.508094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.508747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.510234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.525824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101a805-2afb-4f71-bede-e59a4aaad028 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.536594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:09.538828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:09.566436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.567512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.568071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.568590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.576948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.578771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:09.591912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:09.592854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:09.593811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:09.596146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 389/757] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:09.597256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.618912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 369/758] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:09.618912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.646837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.671819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.752899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2dda4-e463-478f-a01c-577c10254e77 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.762087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470dbe-2fdd-4b27-8752-8219a43e07f8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.798075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.798808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.799159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.799502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.800407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:09.801080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.803019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.807103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.807720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.807997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.808267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.809010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:09.809316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.810760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.821649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 390/759] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:09.822933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.823330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 370/760] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:09.826710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:09.924270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.926169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:09.930333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3338b-278f-45fa-9450-07b574711959 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.938006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c415f-dda6-429d-911a-d40de7546db2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:09.968525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.969276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.969944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.970102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.978821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:09.979736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:09.980164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:09.980380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.980739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:09.981575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:09.982236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.983330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:09.994743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:09.995850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:09.997076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:09.998395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:10.000072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 371/761] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:10.002130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.010677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 391/762] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:10.012238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.127564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51e84-ab91-4c23-98e6-d13d40c64270 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.135920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb52cc-1826-49f5-b392-cc3dd2ac96e5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.176089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.177017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.177352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.177715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.178098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.178346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.178540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.178848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.179690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.179794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=d55ffdc3893f45e0881043a7b10857b6) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.180181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.180463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.182284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.182825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.190212 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 372/763] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:09 2022] GET /identity/v3/role_assignments?user.id=d55ffdc3893f45e0881043a7b10857b6&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:10.191293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.208545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 392/764] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:10.214514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.240803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:10.242037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:10.382736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e532f8-0f07-420e-bd8c-bbfa7768b71e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.404210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93509d-d331-41e8-8cdb-f0804e560dd5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.429628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.431428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.432057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.432546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.451776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.454024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.458210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.458913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.459206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.459495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.460229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.460550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.462041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.475493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 373/765] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:10.475829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:10.476727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:10.477605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:10.477605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:10.477605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:10.477605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:10.482662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 393/766] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:10.487667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.489445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.632039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:10.654533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:10.660626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894659f5-ff1c-41b5-9e9f-6ce3d855dc85 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.697450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.698185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03357-d9b4-4ca7-9980-a6bbdc0606a3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.698347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.698646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.698989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.699736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.700106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.701571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232477-83ef-483d-bdb8-2793356a7fc4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.712569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 374/767] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:10.713976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c294-ff1d-47b7-8411-a212e452a002 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.714339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c294-ff1d-47b7-8411-a212e452a002 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.714708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c294-ff1d-47b7-8411-a212e452a002 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.717707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 375/768] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:10.722786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54c294-ff1d-47b7-8411-a212e452a002 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.746837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.747852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.748343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.748854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.749747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.750260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.751938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a4a7-008a-460d-b374-743b14c4817b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.770754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 394/769] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:10.772086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.772379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.772658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.796347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:10.798208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:10.839972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54c294-ff1d-47b7-8411-a212e452a002 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:10.873392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 395/770] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:10.874686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.886194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:10.887627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:10.888146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:10.890403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:10.891417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] RBAC: Adding query filter params (interface=public, service_id=80e976216d2e499ebc5a5bbc4e30eb9e, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:10.891944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:10.893585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:10.905016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 376/771] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/endpoints?service_id=80e976216d2e499ebc5a5bbc4e30eb9e&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:10.910833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:10.929292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:10.959998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.019056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef158-7a9f-43fe-92ba-31102b364a7d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.030536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f98f1-6c4b-444e-9392-3d63feb6052c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.060204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.060855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.061146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.061425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.068276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.069722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.071496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.072691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.073153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.073599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] PATH_INFO: `/v3/services/network` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.074423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.076279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:11.081164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:11.082186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:11.083217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 396/772] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:11.083763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e3a5e801-f3a9-4635-855d-ffbdbd2faadc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:11.095876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:11.096969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:11.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 377/773] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:10 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:11.099539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b725-26a4-4a68-9978-5791ddc10e43 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.099838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b725-26a4-4a68-9978-5791ddc10e43 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.100125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b725-26a4-4a68-9978-5791ddc10e43 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.101584 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 378/774] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:11.102130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516b725-26a4-4a68-9978-5791ddc10e43 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.190009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.201263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b1df-be12-4d54-b99e-1277c8ac242a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.213423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516b725-26a4-4a68-9978-5791ddc10e43 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.219775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.240251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.240945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.241226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.241497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.242141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.244044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.248367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.248994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.249279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.249558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.254586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 397/775] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:11.254773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:11.254773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.254935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.255048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee36984-cc71-46b1-b392-594a3f78da51 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.275350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 379/776] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:11.276841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.277230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.277646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.301106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:11.302675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:11.394554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345833-79b9-488c-94ea-02ecd77a56c2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.406597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 380/777] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:11.407804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.451914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.452803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.453098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.453411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.454105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:11.454633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.456344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.462685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 398/778] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:11.463549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.503038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.526039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.542811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c66f3f-25f1-48da-a4fa-74ad4508850e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.579490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.580333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.580713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.581086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.583191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=1231588fdfd54ace81dc7b2f35ec6f8a, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.584742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.598044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe83f-c28a-422c-b11b-aa7a6d529feb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.602753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 381/779] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:11 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:58:11.603841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.662422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.663869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.664297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.664773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.690536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:11.697406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:11.698590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:11.699640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:11.708498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 399/780] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:11.713999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.735550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2b61-b2eb-44c1-ba55-0d4ede8c094c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.772828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.781910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.783901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.784317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.784693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.785533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] RBAC: Adding query filter params (type=network) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:11.785947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.787695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.798887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 382/781] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:11.804466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:11.908004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9bfe9-3ae1-478e-8cf7-6d7de884175b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.911678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:11.952393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:11.953704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:11.954435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:11.954896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:11.956150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:11.957054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:11.959277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:11.963503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655e69-2a2b-4d81-b5f9-8336bfb5791d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:11.973767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 400/782] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:11.982493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.028222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.028869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.029161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.029448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.030217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] RBAC: Adding query filter params (interface=public, service_id=9661841124e8414ea38f8ee7e75f8ec7, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:12.030565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.031970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.037675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 383/783] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/endpoints?service_id=9661841124e8414ea38f8ee7e75f8ec7&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:12.043759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.095546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c86de-0f0a-430f-861d-f270f447bb54 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:12.111354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:12.139357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.140537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.141098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.141567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.154246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.156226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.159598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa5b69-3ee9-4137-84e5-b5e482a6a28d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:12.173431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:12.174350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:12.175276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:12.175276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:12.175276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:12.175276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:12.182650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 401/784] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:12.184164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.197157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.197791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.198084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.198369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.199085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.200502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.206330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 384/785] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:12.207952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:12.300724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb4b8-c6e8-44ee-a9bd-dcd478b1e51c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:12.339741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.340395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.340674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.340947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.341662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:12.341966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.343456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.362387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 402/786] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:12.367649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.515035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c59e-4e3b-4dde-9d39-75134a1d87ce None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:12.538197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:12.555624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.557146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.557607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.558055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.566045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.567863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-850f14d3-b599-4688-a2b3-309553f13977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:12.581204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:12.582173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:12.583108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 385/787] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:12.588355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.698607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c318d-031e-4d88-8381-ac30d0246538 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.698947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c318d-031e-4d88-8381-ac30d0246538 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.699200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c318d-031e-4d88-8381-ac30d0246538 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.700795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 386/788] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:12.711623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.711913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.712228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.744511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:12.749343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:12.757829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:12.774169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573068-8962-47bc-8482-9cb6eef28bd4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:12.810502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:12.811150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:12.811436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:12.811717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:12.814870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:12.814870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:12.815424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:12.842691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 403/789] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:12.844455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:12.950225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 387/790] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:12.994148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.009461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f0ea-157a-47af-bb1d-30e83f250591 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.053128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.053855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.054237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.054542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.058227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.069540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.072233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:13.092303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:13.093232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:13.094145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:13.094145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:13.094145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:13.094145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:13.098800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 404/791] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:13.100627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.231257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e24a53-a628-4ae5-bf7a-76428d9c0caa None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.245503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.276767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.277810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.278316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.278922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.294934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:13.302313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:13.303631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:13.304810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:13.308075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 388/792] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:13.313788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.316842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5862ce-b459-4a1a-8787-d75b8147ea59 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.428254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.428811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.429099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.429379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.430090 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:13.430404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.431858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:13.455772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d7ef-307c-44b4-b75d-f797dae22250 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.473200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 405/793] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:13.487636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.504939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.506369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.506833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.507278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.508138 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:13.508586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.510136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:13.521510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 389/794] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:13.534871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.607237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.616020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.694305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4e175-5632-4d1c-8006-11a63fc8da84 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.748250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567689b6-bdc9-49fa-84d9-e5ef4fdd48dd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.760186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.760894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.761186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.761466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.769654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.771144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:13.784255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:13.785163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:13.786024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:13.786457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 406/795] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:13.795260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.824579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.825260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.825544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.825821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.838941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.840878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c69ca46a-8fe1-45af-aaec-7914812e2f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:13.859189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:13.861288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 390/796] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf6c9-58a4-4d14-8a5a-217c57f0491e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.863455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf6c9-58a4-4d14-8a5a-217c57f0491e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.864476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf6c9-58a4-4d14-8a5a-217c57f0491e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.869901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 391/797] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:13.871044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bf6c9-58a4-4d14-8a5a-217c57f0491e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:13.946978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dd70-4613-4c5a-9e70-24c370afd051 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:13.959100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.989217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:13.992211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:13.993046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:13.993999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:13.994433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:13.995342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:13.995870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:13.998303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f817-9d72-4c0b-b85c-6aa0b9d3f880 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.011076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bf6c9-58a4-4d14-8a5a-217c57f0491e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.020461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 407/798] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:14.020461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.020461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.020461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.041831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:14.043975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:14.055198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.056762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.056892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.057291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.058147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:14.058825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.060259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.074960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 392/799] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:14.076015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.132439 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 408/800] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:14.133442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.199256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932ed3-ad98-4b21-9359-a01b5ca12dca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.241110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.241812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.242100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.242378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/87701f1211364da59d0b76bbc737d102/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.251193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.255373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7f6d-c7e4-4deb-8173-16b9a8ff1f6e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.261371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=87701f1211364da59d0b76bbc737d102, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.263179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d4e0-556a-4493-bdaa-e2555facece2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.265983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.279865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 393/801] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:14 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/87701f1211364da59d0b76bbc737d102/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:58:14.292355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda84b-8c34-4832-8ff9-d0a88bdabee8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.292355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda84b-8c34-4832-8ff9-d0a88bdabee8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.292665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda84b-8c34-4832-8ff9-d0a88bdabee8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.298383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 394/802] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:14.298383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda84b-8c34-4832-8ff9-d0a88bdabee8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.310500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.311737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.312262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.313545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.325680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.328569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-34ece430-ad78-448c-bb2d-16a76c81619c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:14.348998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:14.349988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:14.350967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:14.356319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 409/803] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:14.358727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.359656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.360165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.383945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:14.385171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:14.452095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda84b-8c34-4832-8ff9-d0a88bdabee8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.468985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 410/804] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:14.469864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.507569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.508661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.509161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.509405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.510040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.511850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:14.521334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:14.522287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 11:58:14.523144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:14.526554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 395/805] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:14.527479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.582487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.597103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c66b-4b62-4b86-bd14-b3e3d0fff709 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.599533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.634681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.635472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.635858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.636239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.637574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:14.637920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.639501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.651295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42a38d-c939-46da-ae99-58956c9127a3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.660718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 411/806] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:14.661879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.689795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.690815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.691255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.691659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.704163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:14.710302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:14.711399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:14.712967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:14.715385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 396/807] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:14.716318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.779773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265a8e-d73e-4e69-88bb-64518901041c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.820537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.821354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.821733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.822113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.822941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:14.823454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.825056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.827484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a910-bcd2-4ff5-b74e-316018182da4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.829882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 412/808] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:14.830710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.844618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.849249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:14.869405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.870119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.870412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.870716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.884426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:14.885891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d2ff2030-675e-4b0b-947f-86e2f8c54f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:14.901466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:14.907077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 397/809] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd123-d019-4ea4-8bd9-8c84fe9bb504 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd123-d019-4ea4-8bd9-8c84fe9bb504 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd123-d019-4ea4-8bd9-8c84fe9bb504 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.908196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 398/810] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:14.908758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd123-d019-4ea4-8bd9-8c84fe9bb504 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:14.953979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f5729-547a-480a-b1c8-244fb3052051 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:14.995944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:14.996489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:14.997021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:14.997302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:14.998518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:14.999098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.000843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.017071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 413/811] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.017071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.018011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd123-d019-4ea4-8bd9-8c84fe9bb504 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.054613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.055243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.055533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.055952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.056722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.057092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.058498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023743d-03d8-4004-827a-fdea370c8723 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.064224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 399/812] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 3 11:58:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.069735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.070033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.070302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.089262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:15.090484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:15.092734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.120087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.126910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5bb4d-4c05-4aca-9a6e-dce5df3c5d45 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.165124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.165896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.166188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.166553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.167429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.167702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.177613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 400/813] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:15.177807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.177910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.194598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 414/814] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.195472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.280872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5607f1-8ca7-4155-9961-537ae4f06463 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.299442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d2a4-9867-4b71-837c-d39025915e61 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.319421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.320453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.320968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.321822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.331689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.333423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.334930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.337973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.338633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.338914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.339185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.339901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.341238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:15.351900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:15.353022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:15.354067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:15.354067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:15.354067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:15.354067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:15.354067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 401/815] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:15.355303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.368333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 415/816] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:15.369478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.397298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.527766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de0f3-3695-47eb-adf0-88a1352b89fc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.530056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dedb9-84c1-4e21-be66-d1fef62ae635 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.576432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.577140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.577508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.577821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.577956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.578743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.579052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.579395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] PATH_INFO: `/v3/services/network` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.580088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.581536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.585501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.587355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:15.592141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:15.593404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 11:58:15.594461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:15.595564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 402/817] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:15.595564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:15.603568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:15.604634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:15.605695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:15.607469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 416/818] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:15.608355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.668728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.712813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.721313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ded95-99ee-4672-8064-2b23189ee37e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.735677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b1029-416a-4e83-b7b3-8a3c02d76dac None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.757438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.758163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.758538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.759465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.760220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.760595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.762303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.767640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 417/819] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.772862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.785245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.785245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.785245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.785245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.785685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.785685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.785685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.801648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 403/820] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.802643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.878737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a134-495f-46f5-8cd2-d8e9d2e46961 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.894921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:15.908582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1888f-ecd0-4879-b12f-aadcc394f5c5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:15.914724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.915953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.916304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.916653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.917473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.917874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.919415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.932736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 418/821] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.933749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.954101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:15.954794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:15.955085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:15.955366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:15.956055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] RBAC: Adding query filter params (type=network) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:15.956371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:15.957763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:15.963767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 404/822] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:15.964572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:15.968256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.044793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f1cbd-1b1b-4050-9fd2-151626b329b5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.075334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99471f32-7bd1-48a8-9e5a-15acd2512060 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.080227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.080888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.081169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.081445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.100525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:16.103056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:16.117199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.118814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:16.119055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:16.120013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:16.120955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:16.122294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.122819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/d55ffdc3893f45e0881043a7b10857b6/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.124876 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 419/823] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:16.125347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=d55ffdc3893f45e0881043a7b10857b6, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:16.125720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.127290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:16.146210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 405/824] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:15 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/d55ffdc3893f45e0881043a7b10857b6/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:58:16.151806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.160179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.303952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.335770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fae64-74d1-453d-aab3-19c9b1c4d48f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.373644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4644-e199-40fb-bbaa-c2e76f6d2dcf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.386278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.387597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.388152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.388731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.389687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:16.391438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a31e7-2e98-4b82-8680-f41d59c9a0b3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:16.419306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 420/825] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:16.420893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d969ff-d7b3-4489-ab45-b218920d0061 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.421211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d969ff-d7b3-4489-ab45-b218920d0061 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.421488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d969ff-d7b3-4489-ab45-b218920d0061 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.423168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 421/826] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:16.428811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.429165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.429376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.433728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.435035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.435566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.436260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.437577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:16.438159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:16.439957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:16.448859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:16.450128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:16.464729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 406/827] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:16.471896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.589426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 422/828] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:16.624827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.642863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.651586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34976c9-342d-4a95-99cf-b294aa1acfbc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.685022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.717909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.718589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.718969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.719249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.788039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8bd9-74dc-407a-b652-a843cd204f88 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:16.817671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:16.819211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:16.836210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:16.837910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:16.838198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:16.838502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:16.852739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:16.859764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:16.860706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 11:58:16.862039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:16.862889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 423/829] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 11:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:16.867261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.949743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 407/830] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:58:16.955448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:16.976961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:16.981779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.025524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156715-1e73-4859-a63b-04569d50e4da None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.076015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.076816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.077201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.077581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.077728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4c49-1654-414c-a652-6d9f3153c672 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.078549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:17.078962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.081686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.094591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 424/831] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 11:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:17.099534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.122598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.123436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.123548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.123809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.137884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.139464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:17.161217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:17.162147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:17.163075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:17.163075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:17.163075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:17.163075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:17.168590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 408/832] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:17.169469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.254874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8ef04-3708-48fc-a4eb-fcf2695c67f6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.264385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.303180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.303846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.304135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.304413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.309262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.313676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e3b6-f139-4507-970a-39a1c5da0134 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.321419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.323403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:17.340716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:17.341640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:17.342526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:17.342526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:17.342526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:17.342526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:17.344878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 425/833] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:17.351671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.356966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.357610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.357894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.358176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.358933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:17.359248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.360649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.389421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 409/834] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:17.391295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.496094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a2a60-8475-4e97-8630-3a6c65d4d64a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.513460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413926-8c48-4432-8031-0694e2a1ef67 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.545267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.547701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.548747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.549544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.550125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.551808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:17.552130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.553547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.555446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.557519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.558021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.558529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.568015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.569800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.570524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 426/835] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:17.573102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:17.590406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:17.591397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:17.592256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:17.595430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 410/836] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:17.600776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.636304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.692659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d7f55-e7ab-4841-9db0-2c135c558d0c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.732667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c51a29-7348-473f-a156-0294f5fac549 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.733196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.733320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.733602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.733885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.741755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.743289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a4f503b7-ebdd-4224-ba56-e0aa16a236df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:17.755961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:17.756963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:17.757898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 427/837] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:17.758550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f500-1021-4407-8b43-9bbe84a747b9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.759177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f500-1021-4407-8b43-9bbe84a747b9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.759177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f500-1021-4407-8b43-9bbe84a747b9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.760458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 428/838] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:17.763295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f500-1021-4407-8b43-9bbe84a747b9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.775245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.775804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.776093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.776374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.777128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:17.777444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.778931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d8089-100b-457d-94e7-cc0197bd8a99 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.792557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 411/839] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:17.793651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.793942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.794315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.812735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:17.813931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:17.864274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.890588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 412/840] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:17.890588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.895293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f500-1021-4407-8b43-9bbe84a747b9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:17.911249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:17.939065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797768fa-b76a-417a-85de-838602625606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:17.939777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768fa-b76a-417a-85de-838602625606 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:17.940143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768fa-b76a-417a-85de-838602625606 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:17.940417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768fa-b76a-417a-85de-838602625606 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:17.941222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797768fa-b76a-417a-85de-838602625606 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:17.941538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797768fa-b76a-417a-85de-838602625606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:17.943025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797768fa-b76a-417a-85de-838602625606 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:17.962813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 429/841] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:17.968455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797768fa-b76a-417a-85de-838602625606 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:17.997009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388301-976b-47ca-b774-a5dde7a1ccf0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.041985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.043129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.043561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.043996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.045085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:18.045545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.047989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.056513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 413/842] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:18.057834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.084515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797768fa-b76a-417a-85de-838602625606 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.130537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.139759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.141396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.142168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.142711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.143862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.146293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:18.161653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:18.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:18.163605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:18.171160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 430/843] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:18.171667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.202559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a89e-4d51-47dc-b5ba-89defcf4f9c7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.220679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.248067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.249267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.249779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.250263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.324356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e2b26-a1c4-4745-a2ce-c28f339a9a74 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.338990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.340828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40bcf7-476e-4731-8f66-a6bbe705c870 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.362055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.362722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.363007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.363284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.364423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:18.364766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.366147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208673e-8c1f-4ec6-8187-c4d680116927 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.371394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 431/844] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:18.372724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572172ca-8c44-4210-9c7b-1e37b118a9be None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.373021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572172ca-8c44-4210-9c7b-1e37b118a9be None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.373299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572172ca-8c44-4210-9c7b-1e37b118a9be None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.374831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 432/845] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:18.377189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572172ca-8c44-4210-9c7b-1e37b118a9be None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.393564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.454737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 414/846] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:58:18.456029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.456325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.456603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.475592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:18.476841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:18.485609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.496975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572172ca-8c44-4210-9c7b-1e37b118a9be None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.535562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.536469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.536760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.537206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.538221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:18.538645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.540060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.554481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 433/847] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:18.554481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.557196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 415/848] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:18.580957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.677866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3517-de81-422b-9485-11dcef2cc2a5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.691936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.723420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76476ae4-1e95-4721-817c-bc40673160b8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.726910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.727608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.727897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.728180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.741230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.742800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:18.763220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:18.764144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:18.765655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:18.765655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:18.765655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:18.765655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:18.765655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 434/849] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:18.769442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.770081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.770986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.771468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.771917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.783362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:18.788701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:18.789634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:18.791303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:18.794151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 416/850] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:18.801090 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.802041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.910293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6c0a-fb31-4474-9461-748ae918d1d7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.934419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35278e0-fab6-4321-94a2-a6bf7484e686 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:18.947531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.948359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.948814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.949235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.950054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:18.950531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.952035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.966272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 435/851] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:18.971358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:18.980488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:18.981120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:18.981409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:18.981692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:18.982422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:18.982846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:18.984246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:18.985885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:18.999038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 417/852] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:19.000715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.060209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:19.094655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29660-5c50-4259-899f-dbbd88d7c4c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.128440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee717d-0ae4-420b-b091-05d5daa38bf1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.130359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.131060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.131349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.131633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.139726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.141192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:19.153598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:19.154525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:19.155396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:19.159655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 436/853] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:19.160567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.168248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.168897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.169625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.169909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.184560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.186284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:19.205458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:19.207437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:19.208559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:19.208559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:19.208559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:19.208559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:19.208559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 418/854] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:19.215823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.279912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218224-7058-4ed7-ae6d-2643ee244720 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.286088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:19.314718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:19.322706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.323456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.323808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.324154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.324977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:19.325358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.326953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.343874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 437/855] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:19.349456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.366820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c076e-1573-4a72-8f67-7e147c2614b7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.420766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.421324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.421614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.421889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.422885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:19.423204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.424975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.442556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 419/856] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:19.448090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.510127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9079-1820-4e75-8d74-b5775c075b55 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.560059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.560964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.561627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.562051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.563523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=87701f1211364da59d0b76bbc737d102) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:19.564259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.566180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.576003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 438/857] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/role_assignments?user.id=87701f1211364da59d0b76bbc737d102&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:19.586298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b86cf-d87d-4c70-8ff5-aad4358f28c8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.599418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:19.630579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.631660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.632151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.632636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.642864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.644704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:19.659451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:19.660445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 11:58:19.661358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:19.664168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 420/858] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:19.670673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.738859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:19.796042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0045-1767-49df-9dd4-ba7f710e1a54 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:19.841866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:19.842850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:19.843309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:19.843794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:19.844756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:19.845233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:19.846872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:19.872078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 439/859] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:19.880337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:19.992288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8dcb9-bcb4-4cf1-8ef5-731e614a2c9c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.029838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.030911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.031475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.031957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.070187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:20.107778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.109603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bac8e-e208-49cd-86fe-02ad45af66aa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.217213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 421/860] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:58:20.226029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.262157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82915254-096e-4f7f-a3cd-cea5606730c0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.262532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82915254-096e-4f7f-a3cd-cea5606730c0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.262744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82915254-096e-4f7f-a3cd-cea5606730c0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.264232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 422/861] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:20.269497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.269807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.270246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.294103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:20.295347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:20.346421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1070-17bd-4bc9-a12b-33a6fe694813 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.363039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:20.376421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:20.387229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 423/862] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:20.400191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.401198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.401792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.402277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.406907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.418477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.420707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:20.437027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:20.437991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:20.438908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:20.438908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:20.438908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:20.438908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:20.441225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 440/863] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:20.450729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.530496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40778-8165-4c9d-ac3f-6d8fefabd191 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.579323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.580271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.580565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.580846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.581881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.584236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.588995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ce017-7b55-4c43-8cc5-d6279e2ef7cc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:20.598043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:20.599243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:20.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 424/864] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:20.605395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.643402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.644602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.645071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.645520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.646650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:20.647160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.650158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.674472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 441/865] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:20.679022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.692944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:20.712774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:20.774694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22377e3-8945-43e1-a752-9ea20fa3467c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.805063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b719b5-c1b6-4678-8345-64e9e8ffe750 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.818581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.819195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.819488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.819773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.820578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:20.820784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.822875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055d49-93c5-440c-8e4e-3ea611d92546 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.831107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 425/866] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:20.831107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6a2c-7bf2-4085-bb5b-3522241f5a6e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.831107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6a2c-7bf2-4085-bb5b-3522241f5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.831107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6a2c-7bf2-4085-bb5b-3522241f5a6e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.831759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 426/867] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:20.833775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a6a2c-7bf2-4085-bb5b-3522241f5a6e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:20.851338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:20.851994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.852281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.852593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.864942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:20.867015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-26ae8de8-2a44-42ce-9240-7fcceac0b10e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:20.882226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:20.883345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:20.884826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:20.890507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 442/868] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:20.890507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:20.890507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:20.890507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:20.908335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:20.909584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:20.968825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a6a2c-7bf2-4085-bb5b-3522241f5a6e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:20.989010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 443/869] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:20.990110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:21.007880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:21.015110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:21.029425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:21.030472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.030910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.031436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.032132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:21.032449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:21.033928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:21.041073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 427/870] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:21.042712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:21.113501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d80e1f-2407-4a28-91d2-6cfd859dfdc2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:21.168925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:21.170900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.171388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.171782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.173032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:21.173354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:21.175627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:21.188890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1425232-7e04-441b-8a59-8b3d1be409b8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:21.198917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 444/871] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:21.202699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:21.255193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:21.256908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.256908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.257080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.257721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:21.259789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709aa6a-c67a-4836-bfd2-7c93a28084ac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:21.278782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 428/872] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:21 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:21.319472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:21.348343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f4e0-5669-47cf-a17f-8785e73806b4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:21.398854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:21.399992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.400272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.400547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.401352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=d55ffdc3893f45e0881043a7b10857b6) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:21.401713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:21.403315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ff6ce-81d8-4110-8cf0-d79bcec8485c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:21.410772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 445/873] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:21 2022] GET /identity/v3/role_assignments?user.id=d55ffdc3893f45e0881043a7b10857b6&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:21.840056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe201-c68f-4ba1-9794-477e5f7795dc None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.840333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe201-c68f-4ba1-9794-477e5f7795dc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.840616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe201-c68f-4ba1-9794-477e5f7795dc None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.842237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 429/874] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:21.848534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:21.848884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:21.849170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:21.868393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:21.869627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:21.950893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 446/875] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:21.973761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe201-c68f-4ba1-9794-477e5f7795dc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:22.067136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:22.142981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe201-c68f-4ba1-9794-477e5f7795dc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:22.178687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:22.179348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:22.179634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:22.179913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:22.192314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:22.198470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:22.199406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:22.200648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 430/876] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:22.205937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:22.273493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:22.313181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bf8fa-73de-4db8-9599-9759ef850a46 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:22.353637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:22.355142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:22.355662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:22.356137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:22.357066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:22.357582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:22.359212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:22.369622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 447/877] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:22.375689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:22.494116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d262716-9e74-4ae4-9d07-19360d50a815 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:22.520242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:22.531347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:22.532001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:22.532286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:22.532565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:22.545088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:22.546691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:22.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:22.565352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:22.566219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:22.566219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:22.566219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:22.566219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:22.566219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 431/878] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:22.571854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:22.685770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db81c-c1f8-4828-9289-f5e2b6f9e51c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:22.725961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:22.741654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:22.742664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:22.743948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:22.744492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:22.745966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:22.746654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:22.749299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:22.771702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 448/879] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:22.780842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:22.967480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71f29-8d4b-4cd5-8586-35cf42b80b04 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:23.031985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:23.033035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.033533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.034019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.050280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:23.053057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:23.077086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:23.078080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:23.079031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:23.080045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 432/880] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:23.089778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:23.269815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c33cb-a377-4850-9ea7-879f265fc581 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:23.308279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:23.308831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.309115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.309393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.310202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:23.310541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:23.312133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221b1f-bd52-4772-8060-715d732bc6b3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:23.332091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 449/881] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:23.338194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:23.365418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:23.424349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748b3a-d779-4367-a5c4-0cd67f6936b2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.424870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748b3a-d779-4367-a5c4-0cd67f6936b2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.424870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748b3a-d779-4367-a5c4-0cd67f6936b2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.426077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 450/882] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:23.431451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f02d7-2210-4e4c-bbc0-d3b855356fde None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.431750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f02d7-2210-4e4c-bbc0-d3b855356fde None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.432007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f02d7-2210-4e4c-bbc0-d3b855356fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.452654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-024f02d7-2210-4e4c-bbc0-d3b855356fde None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:23.454130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-024f02d7-2210-4e4c-bbc0-d3b855356fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:23.466114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dde1ed-cda4-4319-879d-62ef743f0b73 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:23.512999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:23.526744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:23.527388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.527707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.527945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.554498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 451/883] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:23.554498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97659a-1285-41e3-8e0e-1885cd286da2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.554498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97659a-1285-41e3-8e0e-1885cd286da2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.554498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97659a-1285-41e3-8e0e-1885cd286da2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.556533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 452/884] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:23.563557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110ded-1c47-4644-a87d-c2a737c3a32c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.564197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110ded-1c47-4644-a87d-c2a737c3a32c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.564723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110ded-1c47-4644-a87d-c2a737c3a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.593563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-88110ded-1c47-4644-a87d-c2a737c3a32c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:23.595598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88110ded-1c47-4644-a87d-c2a737c3a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:23.616064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:23.617687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a34fc-25a4-43a7-8b93-a5b7f327cc86 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:23.644376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:23.685206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 453/885] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:23.686646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd54c2-60d2-4773-9def-3f69cb8d43c5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.687087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd54c2-60d2-4773-9def-3f69cb8d43c5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.687388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd54c2-60d2-4773-9def-3f69cb8d43c5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.688952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 454/886] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:23.689653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd54c2-60d2-4773-9def-3f69cb8d43c5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:23.746352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 433/887] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:23 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:58:23.748011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.748298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.748626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.767912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:23.769131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:23.814115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd54c2-60d2-4773-9def-3f69cb8d43c5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:23.816524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:23.854063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 434/888] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:23.854942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:23.874801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:23.875469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:23.875757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:23.876036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:23.876669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:23.878059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:23.888797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:23.890052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:23.891172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 455/889] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:23.891940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:23.929025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:23.993638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c6f7c-6c07-48c3-9258-923e603b2243 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.004217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfc11-a29a-4aae-b63a-cc5cdfcc4085 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.038651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.039265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.039549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.040436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.041118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.042756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.051276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.051928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.052213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.052562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.063928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 435/890] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:23 2022] POST /identity/v3/services => generated 269 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:24.065162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.065839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.067469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:24.088008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:24.089157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:24.090565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:24.090565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:24.090565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:24.090565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:24.090565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 456/891] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:24.090956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.133071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.244493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61364b-ed0f-49c7-b64f-acca47201d58 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.246099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f86e6d-4e43-4f61-9324-a9328a3240f0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.256639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.293194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.293892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.294175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.294465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.295140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.296109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.296675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.297196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.297489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.297819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.298668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:24.298992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.300768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.307698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 457/892] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:24.310416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:24.310684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:24.311601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:24.312497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 436/893] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:24.319558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.436306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.458099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fb2e-c35f-4ea4-bb70-6e1f477e87b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.470966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d69b-3235-4214-bb6c-0f6490a4985b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.515295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.515542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.516028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.516444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.516543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.516738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.516988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.517273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.517506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:24.517830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.518000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:24.518321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.519532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.519810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.531859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 437/894] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:24.531859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.534937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 458/895] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:24.535100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.587555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.672499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213786f-2ab8-47a9-aa1d-ca6d48a73187 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.676003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e407-6db4-4f3b-a66b-f33d682d5667 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.716810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.717613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.717895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.718286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.719099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] RBAC: Adding query filter params (interface=public, service_id=9c86f528d4df4ebd9f7401bfe395129c, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:24.719442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.720871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.726661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.727373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.728259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.728548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.729409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:24.729820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.731390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 459/896] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/endpoints?service_id=9c86f528d4df4ebd9f7401bfe395129c&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:24.731507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.732513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.743336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 438/897] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:24.744341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.754022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.867128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094942b-c5f2-4c39-8e53-f93fc38af827 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.888195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:24.891492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5511c-6e67-44c4-9989-66b3462324a6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:24.910261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.911006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.911369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.911585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.919318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.920811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:24.934964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:24.936155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 460/898] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:24.937237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:24.940780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:24.941417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:24.941697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:24.941979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:24.942738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:24.944132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:24.955004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 439/899] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 11:58:24.956737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:25.044279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:25.091554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6573ca-65ee-4285-8bd5-6d58ec26ac91 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:25.111695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b8179-8ad9-4a14-906e-68034b3c20d8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:25.135010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:25.135576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:25.135869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:25.136153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:25.137133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:25.137425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:25.139065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:25.145513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 461/900] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:25.159740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:25.160619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:25.161048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:25.161400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:25.162335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:25.162751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:25.164649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375da757-2cc6-4124-ad0b-d9e3f041a845 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:25.183256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 440/901] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:25.192680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:25.350712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730cf3-0cfe-4e93-be2e-0a125cdce18e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:25.395370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:25.402321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:25.403069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:25.403473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:25.403761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:25.404628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] RBAC: Adding query filter params (role.id=42bba6cffa2344eabbc5ce4f15a783ec, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=87701f1211364da59d0b76bbc737d102) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:25.404941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:25.406484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a554f4-c34f-4f0a-82a3-1ecfd641c144 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:25.413775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 462/902] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:25 2022] GET /identity/v3/role_assignments?user.id=87701f1211364da59d0b76bbc737d102&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=42bba6cffa2344eabbc5ce4f15a783ec => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:26.415287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f73b-4f82-4e18-b589-eae2f0645aac None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:26.415876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f73b-4f82-4e18-b589-eae2f0645aac None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:26.415958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f73b-4f82-4e18-b589-eae2f0645aac None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:26.417899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 441/903] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:26.424403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:26.424950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:26.425179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:26.450617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:26.451915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:26.566307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 463/904] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:26.599334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07f73b-4f82-4e18-b589-eae2f0645aac None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:26.646529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:26.734520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07f73b-4f82-4e18-b589-eae2f0645aac None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:26.773518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:26.774582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:26.775066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:26.775570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:26.776507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:26.778090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:26.788491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:26.789452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:26.790434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:26.793788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 442/905] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 3 11:58:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:26.800788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:26.940818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d9efe-5e42-45ab-bf7d-927f70f9bf1e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:26.987162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.001050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.001936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.002359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.002877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.004133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:27.004613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.006605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764f4ed-5df5-4665-9e2a-41cbb50cdc38 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.015654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 464/906] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:27.023226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.136872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d2bc-273f-487f-b305-9b38bc5eae90 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.137407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d2bc-273f-487f-b305-9b38bc5eae90 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.137860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d2bc-273f-487f-b305-9b38bc5eae90 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.139557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 465/907] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:27.144943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.145231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.145532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.154501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.168809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:27.170796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:27.173059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b07-4d74-4e69-811e-82b3e904d29c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.224731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.225389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.225680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.225961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.228020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:27.228020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.229040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.240407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 443/908] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:27.241344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.285820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 466/909] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:27.312217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.367068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fadcd-bfc6-4bbc-8ac5-c25dfa84e80b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.411768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.412686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.413108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.413609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.415380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] RBAC: Adding query filter params (interface=public, service_id=28dfa30360924bcea535c613455e17b9, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:27.415961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.417647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e999-0bf3-4955-880f-68a2ec4a07a2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.424118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 444/910] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/endpoints?service_id=28dfa30360924bcea535c613455e17b9&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:27.426649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be60a-0861-4382-bd62-04dc2e96451e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.426649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be60a-0861-4382-bd62-04dc2e96451e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.426649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be60a-0861-4382-bd62-04dc2e96451e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.427355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 445/911] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:27.430213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be60a-0861-4382-bd62-04dc2e96451e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.439349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c97eb-ad30-491a-afee-dbf4e8f41829 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.453159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.463073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.480007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.480972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.481412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.481826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.482665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.484229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bcf7db4c-605f-4e58-b3b6-274f558f9d34 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:27.495745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:27.497337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:27.498717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 467/912] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:27.499568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.499568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.499568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.519428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:27.520625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:27.565188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be60a-0861-4382-bd62-04dc2e96451e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.606547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 468/913] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:27.606547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.610921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.611573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.612316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.612605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.613632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.616009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.624484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 446/914] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 11:58:27.625206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.717368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b60f-4cc4-422a-8f5d-e31de995805b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.731315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.739924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:27.754669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c95d0-87c1-4e6c-8502-d48353a592e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.764640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.765421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.765839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.766131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.766979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:27.767291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.768705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea948-6be3-4d7d-96fb-fa049e00e102 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.774695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 469/915] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:27.780725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4f24-ce17-485d-80c3-5338d156a135 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.781095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4f24-ce17-485d-80c3-5338d156a135 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.781316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4f24-ce17-485d-80c3-5338d156a135 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.783026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 470/916] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:27.788084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4f24-ce17-485d-80c3-5338d156a135 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.796951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.797654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.797948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.798983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.798983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.800375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d63c-0550-4304-a87c-c5b7d3605fd1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:27.822005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 447/917] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:27 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:27.823592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.824093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.824522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.845778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:27.847413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:27.943056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4f24-ce17-485d-80c3-5338d156a135 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:27.944604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 448/918] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:27.968548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:27.990191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:27.991014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:27.991366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:27.991654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:27.992681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:27.993638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:27.995355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.003624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 471/919] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:28.012211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:28.072334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:28.082018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:28.127806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb717-099b-4365-8308-c32de53b62a4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.160690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988af-612c-402f-bd1d-b47d9e4d9ba5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.167901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a2763-648c-4339-906e-4845063a689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.168951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a2763-648c-4339-906e-4845063a689c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.169569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a2763-648c-4339-906e-4845063a689c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.170113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a2763-648c-4339-906e-4845063a689c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.182898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a2763-648c-4339-906e-4845063a689c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-848a2763-648c-4339-906e-4845063a689c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:28.188597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:28.189748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:28.190848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:28.193087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 449/920] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:28.203762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a2763-648c-4339-906e-4845063a689c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:28.204586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.205225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.205512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.205790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.206559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:28.208816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.234054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 472/921] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:28.346028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a2763-648c-4339-906e-4845063a689c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.379091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:28.398420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.399128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.399416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.399702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.400442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:28.400749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:28.402309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.417107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 450/922] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:28.419605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:28.531503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:28.540621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76f33f-4dde-4749-9f89-8d2e52127952 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.577355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.578015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.578297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.578600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.589877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:28.591574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:28.606990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:28.607946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:28.608811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:28.608811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:28.608811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:28.608811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:28.612787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 473/923] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:28.614211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:28.726562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4767-bd47-4128-8ee4-aa40ea54721f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.762879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.763514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.763805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.764089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.764785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:28.765098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:28.766508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.779217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 451/924] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:28.784656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:28.906601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c0cf-edba-4c16-8843-fda24d4eb658 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:28.949552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:28.950230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:28.950561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:28.950846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:28.960569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:28.962777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:28.980372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:28.982662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:28.984952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:28.986835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 474/925] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:28.988875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.045217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:29.117486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68d01-283d-4ca2-bc95-1de51d399391 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:29.162562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:29.163520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.163989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.164466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.166027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:29.166597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:29.168269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:29.194482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 452/926] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:29.196218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.206800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:29.308018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19daa-cd87-4520-bb6a-bc3698e53e4f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:29.345471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:29.346464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.346963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.347419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.362824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:29.364286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:29.380295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:29.381236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:29.382112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:29.382112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:29.382112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:29.382112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:29.387770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 475/927] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:29.393847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.510155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff71ce-61fd-4786-be5d-f96d6a210254 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:29.511984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:29.549478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:29.550203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.550509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.550792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.551496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:29.551808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:29.553197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:29.570403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 453/928] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:29.572505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.639247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:29.684373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef80fe-1b22-473f-be8b-474ced3841ce None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:29.720386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:29.721077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.721370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.721648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.729126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:29.730619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-62bc2904-fed7-4a18-bd51-9b76bc188b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:29.743430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:29.744318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:29.745176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:29.749233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 476/929] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:29.750807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.859169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d788e-2b83-44cc-b509-a09cf3c2bdf3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:29.868665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc96a6-74c1-4602-a6cc-a2145d4bf98b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.868949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc96a6-74c1-4602-a6cc-a2145d4bf98b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.869236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc96a6-74c1-4602-a6cc-a2145d4bf98b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.870896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 477/930] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:29.875947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.876248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.876535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.895823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:29.897041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:29.899683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:29.901146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:29.901435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:29.901715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:29.902494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:29.902811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:29.904382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:29.921721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 454/931] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:29.927401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:29.955865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:29.990737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 478/932] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:30.007070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.041472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48562-dc3d-4ad1-8a22-af680435baba None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.061467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.085513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.087265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.087768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.088259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/87701f1211364da59d0b76bbc737d102/roles/42bba6cffa2344eabbc5ce4f15a783ec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.092227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=87701f1211364da59d0b76bbc737d102, role_id=42bba6cffa2344eabbc5ce4f15a783ec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.095084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789a838-46cf-4609-b42f-0df6c92a9224 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.113093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 455/933] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:29 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/87701f1211364da59d0b76bbc737d102/roles/42bba6cffa2344eabbc5ce4f15a783ec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:58:30.114951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd660-b512-4e94-9120-ce386d9db9ca None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.115428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd660-b512-4e94-9120-ce386d9db9ca None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.115860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd660-b512-4e94-9120-ce386d9db9ca None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.117795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 456/934] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:30.125672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.126705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.126705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.153252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fe17-4426-4211-b3b0-226c62b4375b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.159424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:30.162127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:30.227699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.229329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.230198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.231096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.232562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.235544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:30.253299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:30.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 11:58:30.257289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:30.263747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 479/935] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 3 11:58:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:30.274642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.301236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 457/936] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:30.337133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.353686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.410101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d031-a040-4592-9802-16433f1b4661 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.427505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.457539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.457999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.458253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.458534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.459240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:30.459556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.461099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.467629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 480/937] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:30.473683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.506753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d0139-3494-416a-85fc-e9bac8d57133 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.560307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.561159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.561652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.562156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.563208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.564813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9eec90fe-624d-456a-9fab-2884498349fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:30.575617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:30.576689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:30.577527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:30.578941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 458/938] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:30.580497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b78-9456-48fb-85be-9b0db10987bf None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.581007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b78-9456-48fb-85be-9b0db10987bf None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.581483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26b78-9456-48fb-85be-9b0db10987bf None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.583151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 459/939] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:30.584103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26b78-9456-48fb-85be-9b0db10987bf None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.591039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795e00-023e-4065-b2f3-e1fa96276e6c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.633684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.634476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.634775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.635177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.636180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:30.636530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.638857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0ebc-9059-4a89-8e6a-3ef583cb30ef None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.645967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 481/940] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:30.647471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.647888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.648262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.675080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:30.677125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:30.690735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.718432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26b78-9456-48fb-85be-9b0db10987bf None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.733534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.777634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.778871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.779295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.781375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.781375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:30.783277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.785411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.787888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 482/941] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:30.787888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.795360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 460/942] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:30.801126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:30.917566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f44db-dd4c-4476-b7f7-69afa3d1f018 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.933429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c1c86-280c-4c34-9215-ab0f2134e49b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:30.970592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.971593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.971875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.972162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.973315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.974348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:30.977103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING keystone.server.flask.common [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 11:58:30.988885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:30.989536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:30.989819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:30.990099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:30.990399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:30.990868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:30.992282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.001193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.sql.core [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 11:58:31.001193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 11:58:31.001193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [parameters: {'id': '5c26e89b8b62473a81d78e589d2fafd1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 11:58:31.001193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c26e89b8b62473a81d78e589d2fafd1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c26e89b8b62473a81d78e589d2fafd1. Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:58:31.018953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 03 11:58:31.020953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application yield resource Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise self.value Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application session.commit() Aug 03 11:58:31.022895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.flush() Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application compat.raise_( Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 11:58:31.025309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 11:58:31.026731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:58:31.027878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [parameters: {'id': '5c26e89b8b62473a81d78e589d2fafd1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:31.029140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:31.030278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c26e89b8b62473a81d78e589d2fafd1. Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 461/943] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 3 11:58:30 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:31.032184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:31.034873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 483/944] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:31.041059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:31.088561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:31.196534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870dd77-a682-482c-a17c-130bf94f4959 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:31.214791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f93236-db5a-4c40-928c-cf4884aa4627 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:31.245535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:31.246176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:31.247008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:31.247300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:31.247996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:31.248307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:31.249933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.265957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:31.266648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:31.266935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:31.267122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 462/945] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:31.267232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:31.274182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:31.279144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:31.280772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:31.298526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:31.299900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:31.301316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:31.304746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 484/946] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:31.306611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:31.405897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:31.423532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:31.446905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92e85-77af-46d1-8361-f001090e1d35 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:31.484563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3071af-3115-4972-815c-1dc6fe44f05d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:31.500185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:31.501140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:31.501550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:31.502087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:31.503205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:31.503637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:31.505808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.530280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 485/947] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:31.530904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:31.531711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:31.532154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:31.532438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:31.533232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] RBAC: Adding query filter params (interface=public, service_id=1b3da4da45744354beb8fa8268e4a70d, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:31.533550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:31.542576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079999-4df6-490b-8952-b51374e2df3e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.542576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 463/948] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:31 2022] GET /identity/v3/endpoints?service_id=1b3da4da45744354beb8fa8268e4a70d&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:31.548646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:31.675367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02029-9702-4e42-bc10-8b3af65b10bd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:31.717477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:31.718328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:31.718863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:31.719356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:31.720490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:31.722899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38517-de79-4f1f-a0fa-10cb96db58c8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:31.735001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 486/949] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:31 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 11:58:32.397001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c856-99d7-4cea-ba73-0a032884b228 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:32.397848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c856-99d7-4cea-ba73-0a032884b228 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:32.397848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c856-99d7-4cea-ba73-0a032884b228 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:32.399785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 464/950] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:32.405258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:32.405700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:32.405926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:32.421259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:32.429352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:32.431202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:32.516034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 487/951] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:32.539190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c856-99d7-4cea-ba73-0a032884b228 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:32.664598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c856-99d7-4cea-ba73-0a032884b228 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:32.699924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:32.706677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:32.707605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:32.707893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:32.708170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:32.721508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:32.726678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:32.729876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:32.733086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 465/952] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:32.736068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:32.860610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6434-aa03-4b38-9510-f07533f7ac18 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:32.908738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:32.909404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:32.909692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:32.914484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:32.914484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:32.914484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:32.914484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:32.915453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:32.923417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 488/953] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:32.928992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.051348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552bcd-3a35-4e83-801a-ae28b7c6d748 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.090699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.091378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.091673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.091957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.105242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.106773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:33.123376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:33.125455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:33.127507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:33.127507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:33.127507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:33.127507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:33.127507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 466/954] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:33.130369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.242156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d78e73-5065-43c7-9b1f-65f413046c8b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.280486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.281121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.281413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.281692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.282394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:33.282753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.284130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4a304-c7b7-4151-b605-695fff2fc51e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.298277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 489/955] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:33.303412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.341249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:33.428094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ee9-8ee5-45d7-8777-b27b6cfab902 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.428425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ee9-8ee5-45d7-8777-b27b6cfab902 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.428982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883ee9-8ee5-45d7-8777-b27b6cfab902 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.438142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 490/956] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:33.438410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a798-aad6-450c-920e-9effbbf3f095 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.441653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.441653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.441653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.465417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:33.467056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:33.477816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.478905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.479405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.479891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.492065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.494175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:33.506923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:33.507918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 11:58:33.508868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:33.511563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 467/957] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:33.522642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.537410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:33.567796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 491/958] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:33.581486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.639306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:33.646277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1d373-f485-4652-bf8e-e8a2b6f91825 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.691116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.691752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.692035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.692311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.693111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:33.693422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.695386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.707100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46b307-dbbd-4666-9c8d-2799a4d9a4eb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.719727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 468/959] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:33.726285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.762193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.762957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.763170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.763443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.764084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.765758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:33.780216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:33.781356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:33.782224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:33.786748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 492/960] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:33.787660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.848386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613a29a-a816-47b0-a6dd-9133059897af None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.853085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:33.887707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.888400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.888684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.889080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.905767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815a7fd-deed-4d25-afbb-a864cd26b3b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:33.915491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:33.940906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:33.941530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.941814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.942092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.942804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:33.943113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.944494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea78f34-a483-48ac-9eeb-378957d23bdf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:33.950168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 493/961] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:33.951221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e481d-ae21-4540-ae80-e3dad7ab299d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.951507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e481d-ae21-4540-ae80-e3dad7ab299d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.951791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e481d-ae21-4540-ae80-e3dad7ab299d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.953006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 494/962] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:33.954038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d950ae-34c2-40da-9662-c7ba1f17b437 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:33.954351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d950ae-34c2-40da-9662-c7ba1f17b437 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:33.954635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d950ae-34c2-40da-9662-c7ba1f17b437 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:33.955851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 495/963] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:33.959297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d950ae-34c2-40da-9662-c7ba1f17b437 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:33.967967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:33.969439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647200f-632c-4584-b117-a3f64fa9876e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.065166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d950ae-34c2-40da-9662-c7ba1f17b437 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.068523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 469/964] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:58:34.068523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.068523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.068523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.083201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.089676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:34.091239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:34.101735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.102388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.102696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.102975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.103640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:34.103944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.105308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8961a-5234-468f-b8f6-f4edd3d3e9a9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.109632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 496/965] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:34.110786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.111072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.111627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.134882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:34.136931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:34.144962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.169855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 470/966] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:34.169855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.217079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 497/967] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:34.218175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.292376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5c86-f19c-4bfd-ad4f-f76b3d458edb None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.328503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0591f0e-6fb4-4a35-a7db-7f260bacec83 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.330397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.331205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.331493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.331775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.339837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.344452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.345935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:34.362875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:34.364071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:34.365176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:34.365176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:34.365176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:34.365176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.368782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.369569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.369663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 471/968] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:34.370033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.370405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.370593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.371377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.372959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.375827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING keystone.server.flask.common [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 11:58:34.393291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.sql.core [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 11:58:34.393291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 11:58:34.393291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [parameters: {'user_id': 'd99a148e344e4e69bedd5dc5b7f077dd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 11:58:34.393291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result.read() Aug 03 11:58:34.400487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:58:34.401515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application yield resource Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application next(self.gen) Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise self.value Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application session.commit() Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 11:58:34.407031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.session.flush() Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application compat.raise_( Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 11:58:34.408118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 11:58:34.409202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application conn.query(q) Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application result.read() Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 11:58:34.410190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd99a148e344e4e69bedd5dc5b7f077dd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:34.411220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 03 11:58:34.412168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 498/969] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 3 11:58:34 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:34.414091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.427079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.515238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04019557-6dfd-45ed-8198-47062c886023 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.538069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a975ac-deb5-49cf-8ec7-995de7884c7a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.550372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.551065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.551346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.551624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.552255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.553768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:34.563558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:34.564809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.565641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 472/970] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:34.566427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.583482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.584032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.584316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.584597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.585319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:34.585624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.587251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.601877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 499/971] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:34.603393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.639579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.684020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.687263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d49151-ff0d-498f-b9ab-900b3626977e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.714155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b77d-3834-450c-98d1-c52ba3f6e0cd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.723711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.724715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.725016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.725304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.734787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.736259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:34.748675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:34.749727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 473/972] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:34.751354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.756363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.756995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.757276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.757550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.758259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:34.758604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.759969 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.765764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 500/973] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:34.766667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.869439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ba43e-eab0-44a7-9b5d-aade9e99810e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.874586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.881578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806c1a-1af2-4c9f-8be1-c5881b9db06a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:34.906972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.907732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.908086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.908444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.916074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.917649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.918085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:34.918729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:34.919014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:34.919291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:34.920041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:34.920350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:34.921749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:34.929720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:34.930815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:34.931763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:34.932845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 474/974] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:34.933706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:34.957118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:34.962490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 501/975] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:34.963499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:35.078138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecded0-b026-4d90-8b47-49a1e9ce3578 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:35.083949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4b05-b4ec-4f46-b11c-79321e7d9afa None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:35.123786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:35.124741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:35.125195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:35.125603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:35.126537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:35.127018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:35.128624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:35.137728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:35.138531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:35.138916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:35.139395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:35.140228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:35.140731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:35.142181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:35.144167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 502/976] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:35.149579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 475/977] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:35.152730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:35.156747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:35.178696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:35.281968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:35.299019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc071c5-0e61-42b1-9408-31e2b3f0fad9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:35.299704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79998-12a1-49bb-8e2e-8a7b3160270a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:35.338625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:35.339100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:35.339372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:35.339656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:35.339750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:35.339932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:35.340026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:35.340273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:35.340662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:35.341076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] RBAC: Adding query filter params (role.id=42bba6cffa2344eabbc5ce4f15a783ec, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=87701f1211364da59d0b76bbc737d102) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:35.341393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:35.342077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144afa9-b7bd-4e9c-9c83-700e077c943f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:35.342886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589ee4b-ac31-43e2-b939-121df478136d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:35.354962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 503/978] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:35 2022] GET /identity/v3/role_assignments?user.id=87701f1211364da59d0b76bbc737d102&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=42bba6cffa2344eabbc5ce4f15a783ec => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:35.368599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 476/979] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:36.157340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17f94-85db-4e4e-b4b7-b10086150ed5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:36.157926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17f94-85db-4e4e-b4b7-b10086150ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:36.157926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17f94-85db-4e4e-b4b7-b10086150ed5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:36.159734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 504/980] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:36.166080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02b6-ff70-48b1-bd25-1f84799713e8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:36.166770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02b6-ff70-48b1-bd25-1f84799713e8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:36.166770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02b6-ff70-48b1-bd25-1f84799713e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:36.186323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-835c02b6-ff70-48b1-bd25-1f84799713e8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:36.187559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-835c02b6-ff70-48b1-bd25-1f84799713e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:36.267192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 477/981] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:36.289202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17f94-85db-4e4e-b4b7-b10086150ed5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:36.372468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:36.399910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17f94-85db-4e4e-b4b7-b10086150ed5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:36.435298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:36.435837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:36.436118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:36.436394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:36.437098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:36.438468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25ea63-8105-49c0-954e-2a41e239289b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:36.455515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 505/982] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:36 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:37.469719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417a7-d9fa-4a7e-bee1-1bb472473691 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.470286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417a7-d9fa-4a7e-bee1-1bb472473691 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.470383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417a7-d9fa-4a7e-bee1-1bb472473691 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.472935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 478/983] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:37.479555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.480482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.480962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.501971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:37.503884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:37.580391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014de1-0478-4468-a904-79950db4c336 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.580923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014de1-0478-4468-a904-79950db4c336 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.581419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014de1-0478-4468-a904-79950db4c336 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.583357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 479/984] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:37.589391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.589660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.589923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.590819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 506/985] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:37.613836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:37.614854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:37.614963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:37.690746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:37.698323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:37.713306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 480/986] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:37.736090 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eecb6f-8ec6-4e3c-b898-f4b1b3fea156 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:37.736540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:37.772372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:37.773028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.773313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.773588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.774818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:37.776205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:37.787602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:37.788758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:37.789638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:37.791091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 507/987] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:37.795483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:37.849829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bd48-b8d3-42a9-9371-ae356c24d5d2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:37.887797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:37.888450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.888735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.889379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] PATH_INFO: `/v3/services/image` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.889639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:37.891049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:37.902460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c23920-72c0-4da7-aa8a-dd7d6be7cc72 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:37.902954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:37.903903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:37.904727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:37.909637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 481/988] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 3 11:58:37 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:37.910385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:37.932701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:37.942935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:37.943574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:37.943851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:37.944129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:37.944809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:37.945121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:37.947163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:37.954777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 508/989] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:37.958284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:37.973952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:38.019385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5764-f5a9-4c7d-b7ac-2c3e7a587539 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.058816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.059454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.059769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.060016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.060695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] RBAC: Adding query filter params (name=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:38.061006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.062579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.067759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 482/990] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:38.074941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:38.090048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46470-56da-4537-b8e2-73c6b4d241a2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.130502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.131227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.131583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.131930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.132690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:38.133065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.135278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.140919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 509/991] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:38.146649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:38.192064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af047-b61b-447b-802d-d7bcf0e2462a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.207301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:38.217040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:38.228827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.229461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.229748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.230029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.230732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:38.231042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.232428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.238961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 483/992] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:38.259618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed2882-4634-4a62-b849-3b7ca1488f28 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.299670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.300232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.300585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.300872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.301679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] RBAC: Adding query filter params (interface=admin, service_id=1b3da4da45744354beb8fa8268e4a70d, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:38.302005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.303513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bd478-43f0-462b-ab10-fdfcd0170b93 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.315012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 510/993] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/endpoints?service_id=1b3da4da45744354beb8fa8268e4a70d&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:38.316507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:38.432022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3e32-a051-4159-bdee-17a3310c1be4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.469395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.470039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.470615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.470615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.471293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.472766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf98b2-ee7e-43c2-b487-91861313fdeb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.484642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 484/994] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 11:58:38.531354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831129ec-acef-4ef2-b6e4-ef33953bda6d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.531918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831129ec-acef-4ef2-b6e4-ef33953bda6d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.531918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831129ec-acef-4ef2-b6e4-ef33953bda6d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.533539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 511/995] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:38.539199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.540071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.540327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.561088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:38.562213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:38.623466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:38.646641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 485/996] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:38.669923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831129ec-acef-4ef2-b6e4-ef33953bda6d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:38.778684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831129ec-acef-4ef2-b6e4-ef33953bda6d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.799475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:38.814826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.815407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.815693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.815974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.816605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.817972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:38.827092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:38.828052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:38.828950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 512/997] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:38.835775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:38.939189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934693-7ff8-43eb-9bcf-9c886ec8d625 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:38.976899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:38.978119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:38.978411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:38.978721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:38.979403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:38.979716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:38.981097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:38.992902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 486/998] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:38.993083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:39.096256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe21f8-879c-4d7e-b83e-416666609be6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:39.129847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:39.130520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:39.130772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:39.131048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:39.131714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:39.132022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:39.133924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:39.139200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 513/999] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:39.144813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:39.192356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:39.250998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f9a2-a4a9-458b-8873-062dba5e2b0b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:39.290318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:39.291000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:39.291287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:39.291563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:39.292325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] RBAC: Adding query filter params (interface=public, service_id=fb511c9fd7ef4f02bd6aedaec309ee65, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:39.292637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:39.294028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfb8a3-eb3f-46a5-b982-766bde2f25cb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:39.304686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 487/1000] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:39 2022] GET /identity/v3/endpoints?service_id=fb511c9fd7ef4f02bd6aedaec309ee65&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:39.306089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:39.363847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:39.431745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799877ac-8f4b-41a9-89cf-a5bf9dc08767 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:39.471319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:39.471956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:39.472242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:39.472519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:39.473180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:39.474608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cfff9-93d5-47c3-a3c0-3a8e44f9ded1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:39.494737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 514/1001] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:39 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 11:58:40.277200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c361-ae43-4dce-87f1-3c7b84ba2493 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.277726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c361-ae43-4dce-87f1-3c7b84ba2493 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.277827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c361-ae43-4dce-87f1-3c7b84ba2493 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.279177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 488/1002] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:40.284196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b413f-6b92-4319-b5fa-45ef1a853b06 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.284614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b413f-6b92-4319-b5fa-45ef1a853b06 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.284796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b413f-6b92-4319-b5fa-45ef1a853b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.303156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f95b413f-6b92-4319-b5fa-45ef1a853b06 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:40.304335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f95b413f-6b92-4319-b5fa-45ef1a853b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:40.374121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 515/1003] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:40.396155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c361-ae43-4dce-87f1-3c7b84ba2493 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:40.507364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c361-ae43-4dce-87f1-3c7b84ba2493 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:40.519335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:40.533395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc942-d4cf-4c99-9807-70cb48c27533 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.533669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc942-d4cf-4c99-9807-70cb48c27533 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.533880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc942-d4cf-4c99-9807-70cb48c27533 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.535260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 516/1004] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:40.540819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.541108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.541387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.547042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:40.547902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.549065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.549385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.550124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:40.551550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:40.559581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:40.560899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:40.574914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 489/1005] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:40 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:40.607590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:40.654944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 517/1006] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:40.677274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:40.791114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a13736-b4d1-46c4-a41c-37a94e1b4db8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:40.825207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:40.825865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.826152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.826430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.827081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:40.828462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:40.838298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:40.839522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:40.840347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 490/1007] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 3 11:58:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:40.846107 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:40.950536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555214b-036b-4640-a344-32f9ad03d25e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:40.985325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:40.985956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:40.986241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:40.986607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:40.987234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:40.987544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:40.988990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:40.999371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 518/1008] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:41.000509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:41.037156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:41.111277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d439-b00d-4816-ab99-142b141f81f3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:41.146394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:41.147048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.147336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.147617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.148291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:41.148619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:41.150026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424812c8-d311-4bbe-a900-81405474c267 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:41.159751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 491/1009] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 3 11:58:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:41.161334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:41.194274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:41.266814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992757-af2f-4034-be09-76c5e492f7c2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:41.302023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:41.302733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.302959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.303213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.303920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:41.305929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b3f67-5b1d-443b-b9d9-2c74db60ac01 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:41.330480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 519/1010] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:41.533355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f608a2a-90fd-4d5a-bc07-64b4c2b22a76 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.533861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f608a2a-90fd-4d5a-bc07-64b4c2b22a76 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.533937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f608a2a-90fd-4d5a-bc07-64b4c2b22a76 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.535424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 492/1011] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:41.541171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.541457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.541734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.560390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:41.561576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:41.638430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 520/1012] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:41 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:41.660961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f608a2a-90fd-4d5a-bc07-64b4c2b22a76 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:41.763866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:41.770248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f608a2a-90fd-4d5a-bc07-64b4c2b22a76 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:41.809149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:41.811270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.811270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.811270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.811270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:41.812446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:41.822385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:41.823524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 11:58:41.824343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:41.826792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 493/1013] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:41.829740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:41.848769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:41.933272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7f9d-cf5b-478f-b7a4-1b42454fa8b7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:41.967027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:41.967657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:41.967939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:41.968212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:41.968883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:41.969190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:41.970622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:41.981040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 521/1014] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:41.982282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:42.088163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb00af4-e4cb-4c04-9f1e-c76edbf56870 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:42.123235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:42.123869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:42.124157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:42.124437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:42.125123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:42.125552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:42.127055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b52cc6-36a4-41bb-aeba-9720f2be650b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:42.133797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 494/1015] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 3 11:58:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:42.138866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:42.223344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:42.242733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f648f-9c7f-4665-ad1d-6cbb4202e86a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:42.277406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:42.278027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:42.278309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:42.278627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:42.279344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:42.280696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48e654-b569-4dc0-a9a9-15645f4f940d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:42.309455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 522/1016] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:58:42.623779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d19ca-8c84-4495-a848-3a2137414595 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:42.624303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d19ca-8c84-4495-a848-3a2137414595 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:42.624413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d19ca-8c84-4495-a848-3a2137414595 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:42.626012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 495/1017] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:42.631590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:42.631879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:42.632170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:42.652838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:42.654063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:42.779628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 523/1018] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:42.820578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d19ca-8c84-4495-a848-3a2137414595 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:42.850956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:42.937845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d19ca-8c84-4495-a848-3a2137414595 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:42.975034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:42.976066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:42.976547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:42.977560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:42.978373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:42.979963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:42.989954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:42.991065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:42.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 496/1019] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 3 11:58:42 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:42.999720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.064269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:43.105295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e57e6-ace1-41b7-89a3-6b6c6f026efa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.140115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.140754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.141042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.141321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.142005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] RBAC: Adding query filter params (name=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:43.142315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.143721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.154142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 524/1020] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:43.155146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.250769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:43.262335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af81874-65b6-4ad6-8187-67073b41aee4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.297476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.298112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.298397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.298705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.299463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] RBAC: Adding query filter params (type=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:43.299780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.301154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b7bb-77c0-49e5-b6d1-369b69cdb7ab None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.310613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 497/1021] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:43.312775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.406436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6f7b-1b24-4c5e-b067-828c0b819500 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.406707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6f7b-1b24-4c5e-b067-828c0b819500 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.406963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a6f7b-1b24-4c5e-b067-828c0b819500 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.408475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 498/1022] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:43.413320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.413620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.413909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.419777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be79a-d1fb-4996-be5a-9cc2c1306504 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.433280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:43.434558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:43.455571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:43.466268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.466979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.467217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.467496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.468255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] RBAC: Adding query filter params (interface=public, service_id=06e6a393bed544098875b0dc87c9ab50, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:43.468572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.470134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.475892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 525/1023] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 11:58:43 2022] GET /identity/v3/endpoints?service_id=06e6a393bed544098875b0dc87c9ab50&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:43.482173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.522346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 499/1024] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:43.547205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.612154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcaa77-389e-44c1-9c03-729fd3ec2eaf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.646713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:43.652713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.654139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.654684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.655183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.656415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.659112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.664522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cccdac-4dbc-4f12-b4d8-6a74744666c1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.682487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 526/1025] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 11:58:43 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 11:58:43.713618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.714287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.714610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.714894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.716116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.717651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc99e-e0e1-437e-bca2-67e42ef1d1aa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.719398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 500/1026] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:43.725628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:43.789067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:43.838639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4455e39-6db8-4a63-85fc-5fc19e24139f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:43.873312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851062f-3d71-451e-a108-257350661b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:43.873937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851062f-3d71-451e-a108-257350661b99 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:43.874220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851062f-3d71-451e-a108-257350661b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:43.874693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851062f-3d71-451e-a108-257350661b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:43.875447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851062f-3d71-451e-a108-257350661b99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:43.876872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851062f-3d71-451e-a108-257350661b99 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:43.910632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 527/1027] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:58:43 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:44.508947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0997b-f30a-4fe0-9f47-ee23aec3cec2 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:44.509280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0997b-f30a-4fe0-9f47-ee23aec3cec2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:44.509522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0997b-f30a-4fe0-9f47-ee23aec3cec2 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:44.510968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 501/1028] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:44.516371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:44.516829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:44.516920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:44.534759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:44.535961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:44.611278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 528/1029] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:44.638453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0997b-f30a-4fe0-9f47-ee23aec3cec2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:44.745155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0997b-f30a-4fe0-9f47-ee23aec3cec2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:44.779925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:44.780448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:44.780736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:44.781014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:44.791932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:44.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:44.798016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:44.798889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 502/1030] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:44.804186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:44.846993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:44.909576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845680e9-b1a9-4de2-b9f5-e7ab9034d171 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:44.944253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:44.944876 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:44.945156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:44.945430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:44.946176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:44.946508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:44.947871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:44.960881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 529/1031] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:44.964458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:44.981618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:45.077452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b8cc-da76-4ef1-b052-c3ea0b8a73af None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:45.112872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:45.113519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.113802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.114077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.125018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:45.126492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:45.141687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:45.142965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:45.143951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:45.143951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:45.143951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:45.143951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:45.143951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 503/1032] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:45.148656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:45.246555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:45.250891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77fe7-d4bb-4f97-8024-f746f9058180 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:45.285767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:45.286399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.286795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.286976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.287655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:45.287959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:45.289370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:45.305861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 530/1033] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:45.307025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:45.370639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:45.412961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebc9e-c36a-445b-81bc-3a4670c995e9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:45.448033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:45.448677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.448960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.449235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.457400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:45.459075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:45.472548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:45.473610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:45.474656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 504/1034] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:45.483985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:45.586798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9744d-b3d1-40a0-bfa3-127ce5bf8762 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:45.630839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:45.631379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.631659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.631932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.632721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:45.633612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:45.635231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112bc6d-ffb4-46e3-a5c7-50b8e92542a0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:45.657788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 531/1035] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:45.659354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:45.755121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd019-6cb4-4bf7-ad87-4e3946653b4c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.755418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd019-6cb4-4bf7-ad87-4e3946653b4c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.755886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd019-6cb4-4bf7-ad87-4e3946653b4c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.757290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 532/1036] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:45.763802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.764119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.764372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.775552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e6084-e183-47c3-968f-a5a710b37fc6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:45.783568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:45.784813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:45.801976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:45.808392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:45.821475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:45.822119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:45.822406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:45.822732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:45.878567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 533/1037] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:45.900172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:45.904354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:45.905838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05742a-bbf5-40e9-b420-08b9443400b3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.010493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e8ac0-9c4a-4e08-90d4-79d14f875a95 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.016238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 505/1038] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:58:46.017541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb853-02a0-4492-a555-68527868cb81 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.017836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb853-02a0-4492-a555-68527868cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.018127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb853-02a0-4492-a555-68527868cb81 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.019419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 506/1039] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:46.021916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb853-02a0-4492-a555-68527868cb81 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.046606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.047253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.047541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.047696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.047883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] PATH_INFO: `/v3/services/image` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.048581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.050002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0a78d83e-7d20-4850-a96a-1f59af10189a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:46.059649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:46.060896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:46.061808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 534/1040] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 3 11:58:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:46.062692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.062692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.062692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.080854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:46.082057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:46.089909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.124887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb853-02a0-4492-a555-68527868cb81 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.153419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 535/1041] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:46.154256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.161447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.162096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.162379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.162679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.173757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.175241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:46.190837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:46.191772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:46.192679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:46.192679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:46.192679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:46.192679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:46.192679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 507/1042] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:46.192995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.256235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a49bf1-b103-457e-884d-a26097875010 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.271728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.290871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.291507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.291787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.292061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.292743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:46.293049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.294429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.296068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5bff-c43e-4dda-80bd-0914653f2862 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.299552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 536/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:46.300360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.309367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.333271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.333916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.334204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.334512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.335661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.337190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.339042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 508/1044] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:46.339611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.403641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3e77-3cbd-4ab7-a413-14fba468ddd6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.437402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.438022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.438299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.438612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.439299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:46.439602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.441049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.448416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88521d4-a096-4fa5-8814-a966ecc1b64e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.452818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 537/1045] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:46.453607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.486235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.486911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.487201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.487482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.488170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] RBAC: Adding query filter params (type=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:46.488477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.489867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.495520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 509/1046] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:46.496324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.507391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.528083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.563418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b115e6-72f5-40a6-ac79-bd61055f1fb1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.596651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.597328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.597537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.597814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.598075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165eca1-f910-4b53-9882-e40e6f190056 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.598521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.599944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.642471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 538/1047] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:58:46 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:46.642471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.642801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.642801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.642801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.642801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.643581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.645101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:46.658024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:46.659177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:46.660080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 510/1048] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:46.665974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.748722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.749357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebc538-c293-42c6-ac98-3af2adff6279 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.775016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:46.790005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600aec1-7fff-4698-ae0a-dfcf9d24220d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:46.793499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.794383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.794653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.794742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.795726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.796828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.820057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 539/1049] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 11:58:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:58:46.837259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:46.837898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:46.838180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:46.838517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:46.839257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:46.839569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:46.841069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cf2b2-ff8f-4799-94e4-7b47e18a37f5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:46.856908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 511/1050] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:46.863799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:46.981283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efac86-ba37-4d56-aec7-4f03977269f2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:47.020188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:47.020821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:47.021108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:47.021390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:47.022180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] RBAC: Adding query filter params (role.id=42bba6cffa2344eabbc5ce4f15a783ec, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:47.022587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:47.024648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbf015-c3f1-4bad-aa58-91012c17194a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:47.030721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 540/1051] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:46 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=42bba6cffa2344eabbc5ce4f15a783ec => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:48.713169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573b8-664f-4ef6-bf60-539e460d46f3 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:48.713687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573b8-664f-4ef6-bf60-539e460d46f3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:48.713763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573b8-664f-4ef6-bf60-539e460d46f3 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:48.715271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 512/1052] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:48.720633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86bc6-4092-44be-8bd5-977b5398b71c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:48.721099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86bc6-4092-44be-8bd5-977b5398b71c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:48.721321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86bc6-4092-44be-8bd5-977b5398b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:48.739616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d4f86bc6-4092-44be-8bd5-977b5398b71c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:48.740730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d4f86bc6-4092-44be-8bd5-977b5398b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:48.779086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:48.813981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 541/1053] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:48.836622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25573b8-664f-4ef6-bf60-539e460d46f3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:48.868372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bfe05-ec66-4bbd-826b-b1a35f087d83 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:48.868639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bfe05-ec66-4bbd-826b-b1a35f087d83 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:48.868920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bfe05-ec66-4bbd-826b-b1a35f087d83 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:48.870292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 542/1054] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:48.876857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:48.877160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:48.877420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:48.895864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:48.897122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:48.946050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25573b8-664f-4ef6-bf60-539e460d46f3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:48.970503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 543/1055] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:48.974888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:48.989236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:48.990378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:48.990967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:48.991209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:48.991541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.005182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:49.010830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:49.012319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:49.013376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:49.016126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 513/1056] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:49.022061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.100254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313c48-5883-433b-bb4f-d1d90930e8b7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.102287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.123450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1c53-687f-41e9-8e47-c40ad2bb8147 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.135657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.136281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.136563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.137095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.157544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.158166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.158473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.158754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.159469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:49.159776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.161147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6fe8e-f2e4-4500-828e-26810f27ae5d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.170115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 514/1057] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:49.171476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0c2-08c5-445e-bf0c-e074a21da2fc None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.171772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0c2-08c5-445e-bf0c-e074a21da2fc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.172059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0c2-08c5-445e-bf0c-e074a21da2fc None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.173433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 515/1058] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:49.177837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e0c2-08c5-445e-bf0c-e074a21da2fc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.209389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.210925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e81b-5853-4f5b-88c6-02275ca7817a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.230954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.291286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e0c2-08c5-445e-bf0c-e074a21da2fc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.319045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 544/1059] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:58:49.320482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.320775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.321055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.327475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.328903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.329728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.329992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.330469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] PATH_INFO: `/v3/users/d9145f693485443782c31ecac7ee928b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.341427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:49.342678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:49.346538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] RBAC: Authorizing `identity:get_user(user_id=d9145f693485443782c31ecac7ee928b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.348044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.349977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 516/1060] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/users/d9145f693485443782c31ecac7ee928b => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:49.350837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.421487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 545/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:49.422432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.470919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81608d-b6d4-4f95-a290-7e82e31786b8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.473823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.510693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.511332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.511612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.512161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.523178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.525191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.530796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13209bd1-dd0c-460b-8491-e9a42647b7a0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:49.541178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:49.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 517/1062] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:49.543413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.566230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.573312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.573945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.574239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.574544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.642633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.644038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.644354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de6ac7-7302-4579-a460-caf78ea76d30 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.678740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.679385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.679674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.679997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.690100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:49.697134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:49.698267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 518/1063] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:49.699150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.717284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.747588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 546/1064] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:58:49.748445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.783661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.804371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b237-24af-40b6-bba7-d692155c20f2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.839954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.840588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.840878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.841163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.841859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:49.842174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.843614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.852595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b4da-0fb3-4a4d-95d2-c98b0e87107d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:49.856049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 519/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:49.856886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.890756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:49.891413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:49.891701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:49.891985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:49.892730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:49.893050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:49.894495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:49.909414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 547/1066] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:49.910711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:49.967795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:49.999533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627110-e00a-4d98-be1c-a14321c4a986 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.032213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:50.040652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487c8ff-505c-4e2e-83d5-1ad2f8155c0e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.046270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.046981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.047269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.047546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.048750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.050632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.052341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 520/1067] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:50.058617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.087254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.087920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.087920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.088520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.102038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.103546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:50.121975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:50.122975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:50.123887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:50.123887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:50.123887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:50.123887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:50.124185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 548/1068] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:50.130458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.173962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ceeb-b9f1-4e3c-a4e2-bff86fc0873b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.212569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.213192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.213479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.213757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.214590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691, user.id=d9145f693485443782c31ecac7ee928b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:50.214906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.216362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.222480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 521/1069] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/role_assignments?user.id=d9145f693485443782c31ecac7ee928b&scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:50.241196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332e6d4-494c-49bc-ab7b-799ff721b63f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.282087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.282768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.283053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.283328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.284065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:50.284373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.285810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.301157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 549/1070] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:50.307824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.320588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:50.415568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a34fb-db65-4c65-a686-d3aa79f0a670 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.449301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.449948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.450233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.450540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.458351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.459847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:50.471594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:50.472577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:50.474088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 522/1071] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:50.479154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.488234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:50.581079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef18f60-e275-4bf7-ad0c-593e31642a10 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.620128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767468d6-91c0-4296-8317-0909b717227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.620752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767468d6-91c0-4296-8317-0909b717227e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.621039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767468d6-91c0-4296-8317-0909b717227e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.621319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767468d6-91c0-4296-8317-0909b717227e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.622115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767468d6-91c0-4296-8317-0909b717227e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:50.622465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767468d6-91c0-4296-8317-0909b717227e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.623883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767468d6-91c0-4296-8317-0909b717227e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.641317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 550/1072] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:50.646937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.717343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:50.751992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c46a93-016c-42a9-9773-4522d1303650 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.785481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.786122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.786408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.786723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.797766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.799250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:50.813183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:50.814124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:50.815698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:50.815698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:50.815698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:50.815698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:50.815698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 523/1073] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:50.820058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767468d6-91c0-4296-8317-0909b717227e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:50.881890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:50.920670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767468d6-91c0-4296-8317-0909b717227e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:50.954626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:50.955268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:50.955558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:50.955841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:50.956539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:50.956854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:50.958234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:50.970496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 551/1074] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:50.976265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:51.077302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea162-e7b5-4ec0-8835-169304e44c2a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:51.097583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:51.113293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:51.113932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:51.114214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:51.114512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:51.121119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:51.122766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:51.134605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:51.135679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:51.136582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 524/1075] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:51.141763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:51.240264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9816b-08e8-4a20-b760-cee202aba412 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:51.263147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:51.274982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:51.275606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:51.275888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:51.276165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:51.276903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:51.277211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:51.278649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c29d15-2b2e-4ae5-ada0-68a530f414c1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:51.291116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 552/1076] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:51.296934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:51.401184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9997-2953-4bc1-be59-daf24556679c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:51.434660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:51.435329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:51.435613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:51.435893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/42bba6cffa2344eabbc5ce4f15a783ec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:51.438067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=1231588fdfd54ace81dc7b2f35ec6f8a, role_id=42bba6cffa2344eabbc5ce4f15a783ec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:51.439549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06da891-4d90-49ec-907b-39db9df1230c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:51.452556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 525/1077] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:51 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/1231588fdfd54ace81dc7b2f35ec6f8a/roles/42bba6cffa2344eabbc5ce4f15a783ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 11:58:52.243701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e2f5-da72-43ea-b15f-04f4272b0df8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.244235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e2f5-da72-43ea-b15f-04f4272b0df8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.244235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e2f5-da72-43ea-b15f-04f4272b0df8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.245604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 553/1078] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:52.250783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.251241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.251333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.270114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:52.271334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:52.305494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:52.342864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 526/1079] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:52.367138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251e2f5-da72-43ea-b15f-04f4272b0df8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:52.470784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251e2f5-da72-43ea-b15f-04f4272b0df8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:52.505707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:52.506354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.506661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.506937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.517703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:52.522675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:52.524406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:52.525438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:52.526596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 554/1080] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:52.530401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:52.636493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9cf97-c1c9-403a-9720-4de6b6662444 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:52.673059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:52.673692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.673980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.674257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.675011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:52.675322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:52.677101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:52.686511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 527/1081] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:52.692269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:52.738566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:52.791788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7507ec-ede0-44e9-9c28-d7d398ceed13 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:52.824475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:52.825114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.825398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.825676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] PATH_INFO: `/v3/users/d9145f693485443782c31ecac7ee928b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.826860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] RBAC: Authorizing `identity:get_user(user_id=d9145f693485443782c31ecac7ee928b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:52.828293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:52.829905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 555/1082] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:58:52 2022] GET /identity/v3/users/d9145f693485443782c31ecac7ee928b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:52.835705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:52.867719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:52.936606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593ddb-9b2e-4bc5-8c46-9948bc73b6f9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:52.969404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:52.970046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:52.970330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:52.970635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:52.971830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:52.973261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d8f5-7227-4531-8241-131c9ba3002f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:52.974973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 528/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:58:52 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:52.981014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:53.079416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4376df-e054-4de9-a855-6ff6b5da59b6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:53.092692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:53.113325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:53.113989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:53.114269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:53.114577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691/users/d9145f693485443782c31ecac7ee928b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:53.116481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] RBAC: Authorizing `identity:create_grant(project_id=9fe2b099d7c94cb3b8d71be5cab40691, user_id=d9145f693485443782c31ecac7ee928b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:53.118457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952cf59-6fb0-45c4-ad17-cbdc9f8c29be None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:53.131205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 556/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:58:52 2022] PUT /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691/users/d9145f693485443782c31ecac7ee928b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 11:58:53.475111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98a1a-c7a2-498b-a354-54be8f715542 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:53.475626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98a1a-c7a2-498b-a354-54be8f715542 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:53.475626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98a1a-c7a2-498b-a354-54be8f715542 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:53.477547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 529/1085] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:53.483518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:53.483919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:53.484087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:53.502852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:53.504048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:53.573091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 557/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:53.595989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b98a1a-c7a2-498b-a354-54be8f715542 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:53.695768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:53.700294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b98a1a-c7a2-498b-a354-54be8f715542 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:53.735438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:53.735979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:53.736269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:53.736551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:53.747204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:53.752130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:53.753234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 11:58:53.754275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:53.758398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 530/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 3 11:58:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:53.759441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:53.858146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa256-beb8-4138-8a7c-c37a722ff396 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:53.859755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:53.894588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:53.895215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:53.895498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:53.895776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:53.896488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:53.896797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:53.898265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:53.906643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 558/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:58:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:53.912328 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.017994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5002-8cf1-4341-9afd-0ed30e348412 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:54.052460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:54.053108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:54.053394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:54.053674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:54.064251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:54.065699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:54.080546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:54.081576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:54.082544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:54.082544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:54.082544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:54.082544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:54.082544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 531/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:54.088555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.188862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c144-e8d4-44f8-bf07-dfea98accc9c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:54.223690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:54.224323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:54.224611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:54.224891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:54.225584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:54.225901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:54.227336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:54.239884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 559/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:54.245881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.262800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:54.350929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314e8e9-860f-438c-965d-d088f098825d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:54.385567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:54.386213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:54.386530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:54.387080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:54.394918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:54.396350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 11:58:54.408078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:54.409089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 11:58:54.410016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:54.410958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 532/1091] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 3 11:58:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:58:54.415124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.440459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:54.523015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c62d3-d346-4cac-a769-06c29d997198 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:54.555786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:54.556407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:54.556683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:54.556953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:54.557736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:54.558045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:54.559492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:54.576703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 560/1092] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 3 11:58:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:54.582487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.651592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:54.682353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac240d-696a-45fd-8c2a-66f66910401f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:54.716011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:54.716640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:54.716926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:54.717208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:54.787217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:54.788716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:54.858377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:54.889698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 533/1093] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:58:54.895529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:54.977135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:54.996756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e989d7d-95be-4bab-b9d9-6e9279b8d11e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.031303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.031983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.032271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.032550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.043167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.044616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0a46e482-cad4-4a15-91d2-4252110bd37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:58:55.059831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:55.060913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:55.062276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 11:58:55.062276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:58:55.062276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 11:58:55.062276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:55.062276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 561/1094] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:55.066722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.152978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cf93-2dbd-4560-a167-ad2e2bd9c2cf None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.153267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cf93-2dbd-4560-a167-ad2e2bd9c2cf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.153547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587cf93-2dbd-4560-a167-ad2e2bd9c2cf None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.155019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 562/1095] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:58:55.161218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c7a3-2775-448e-a668-69064245d3de None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.161512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c7a3-2775-448e-a668-69064245d3de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.161794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c7a3-2775-448e-a668-69064245d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.169256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40a0e-dd8c-42d3-a2ea-c14fbc9f2c29 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.181252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f114c7a3-2775-448e-a668-69064245d3de None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:55.182512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f114c7a3-2775-448e-a668-69064245d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:55.206286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.206969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.207267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.207545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.208258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:55.208583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.210005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.223374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 534/1096] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:55.229831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.260541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 563/1097] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:58:55.263665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:55.284848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c7a3-2775-448e-a668-69064245d3de None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.337528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2d72-ff3b-4471-8853-ff19a08bef55 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.350796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:55.373564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.374214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.374576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.374820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.381625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.383169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.392256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c7a3-2775-448e-a668-69064245d3de None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 11:58:55.395991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:55.397054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:58:55.403569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 535/1098] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:55.404077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.427408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.428062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.428350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.428630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.438881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:58:55.443829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:58:55.444991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:58:55.446061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 564/1099] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:58:55.451131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.502631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:55.512392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7fb8-8fbc-4ff3-9cad-5f0591d28ad6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.546190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.546963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.547252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.547535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.548313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:55.548628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.550075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.554258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2f2e1-5965-4891-8b32-19fda7466b9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.562348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 536/1100] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:55.568525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.581221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:55.593628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.594254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.594570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.594849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.595560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:55.595869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.597246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.605718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 565/1101] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:55.611429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.672765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3bc1-e0a7-47dd-8cf5-1de482c4f969 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.707294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.707913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.708198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.708478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.709260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] RBAC: Adding query filter params (role.id=42bba6cffa2344eabbc5ce4f15a783ec, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=1231588fdfd54ace81dc7b2f35ec6f8a) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:55.709576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.711615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.711812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc095b-2157-4c06-a4ee-bd21a391f648 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.717535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 537/1102] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/role_assignments?user.id=1231588fdfd54ace81dc7b2f35ec6f8a&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=42bba6cffa2344eabbc5ce4f15a783ec => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:55.749653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.750241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.750554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.750834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] PATH_INFO: `/v3/users/d9145f693485443782c31ecac7ee928b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.752080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] RBAC: Authorizing `identity:get_user(user_id=d9145f693485443782c31ecac7ee928b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.753549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.755322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 566/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/users/d9145f693485443782c31ecac7ee928b => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:58:55.762120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:55.782791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:55.868712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea232a-8275-4a40-843c-fcba43f9c220 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:55.904327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:55.904960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:55.905236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:55.905513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:55.975213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:55.976873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:55.995603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:56.082091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 538/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:58:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:58:56.088179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:56.147599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:56.193851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26999-7111-4f88-9447-4e07c7897c22 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:56.231494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:56.232146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:56.232427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:56.232701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:56.233847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:56.235308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efd7d7-fb81-42ce-bfc2-80c3e0cc39d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:56.236999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 567/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:58:56 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:56.243788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:56.349046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e740-15bf-4f27-bf98-cd00c4a30751 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:56.366720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:56.388603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:56.389239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:56.389527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:56.389807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:56.390637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691, user.id=d9145f693485443782c31ecac7ee928b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:58:56.390957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:56.392391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59536d-12f8-4bb0-916c-1327f05e4db0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:56.399038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 539/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:58:56 2022] GET /identity/v3/role_assignments?user.id=d9145f693485443782c31ecac7ee928b&scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:58.445448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483a779-47e4-4692-9fe4-cae0c1a7aed2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:58.446112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483a779-47e4-4692-9fe4-cae0c1a7aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:58.446112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483a779-47e4-4692-9fe4-cae0c1a7aed2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:58.447406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 568/1107] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:58:58.453086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:58.453594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:58.453711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:58.472554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:58:58.473738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:58:58.542461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 540/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:58:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:58:58.566422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483a779-47e4-4692-9fe4-cae0c1a7aed2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:58.668599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483a779-47e4-4692-9fe4-cae0c1a7aed2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:58.691578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:58.704208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:58.704773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:58.705055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:58.705337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:58.706812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:58.708064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad7500-c30d-4083-837a-b2d8170d3617 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:58.711819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 569/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:58:58.717716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:58:58.823614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96b3f-e863-4eb3-bf3a-83c55ea2ff1e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:58:58.835265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:58:58.860032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:58:58.860650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:58:58.860936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:58:58.861215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:58:58.861905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:58:58.863379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f48e-2327-4da9-94d7-575ae8185f83 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:58:58.887433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 541/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:58:58 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:59:00.969717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1173e3-811a-465c-8b62-76c2145a11cc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:00.970273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1173e3-811a-465c-8b62-76c2145a11cc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:00.970273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1173e3-811a-465c-8b62-76c2145a11cc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:00.971683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 570/1111] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:00.977183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:00.977611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:00.977737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:00.996295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:00.997538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:01.064754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 542/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:01.088587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1173e3-811a-465c-8b62-76c2145a11cc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:01.189551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1173e3-811a-465c-8b62-76c2145a11cc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:01.223488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:01.224056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:01.224342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:01.224624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] PATH_INFO: `/v3/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:01.226067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] RBAC: Authorizing `identity:get_role(role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:01.227476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:01.228829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 571/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:01 2022] GET /identity/v3/roles/a459998da52847ad9ba273f6520dabca => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:01.234695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:01.327560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:01.334628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae500fef-5337-4f35-b6c6-fb4b3dd55487 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:01.369039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:01.369685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:01.369976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:01.370258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] PATH_INFO: `/v3/users/befc6138692543219697c2205cc4e032` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:01.383908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=befc6138692543219697c2205cc4e032)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:01.385385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:01.387411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 543/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:01 2022] GET /identity/v3/users/befc6138692543219697c2205cc4e032 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:01.393102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:01.450221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:01.492633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ca2-e59b-45e3-8306-3cf7d090231e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:01.527202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:01.527816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:01.528097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:01.528370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:01.593051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:01.594523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:01.648972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:01.696250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 572/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:59:01.702314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:01.801305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624590a-e844-48ed-9b01-e552d2e0e7e6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:01.835219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:01.835866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:01.836155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:01.836440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:01.837597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:01.839106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486dd4d-d106-4b32-8b3d-628eaa8fbfce None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:01.840798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 544/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:01 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:01.846992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:01.942900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de83b-4c85-4d6d-8290-ae0b8da12337 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:01.975441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:01.976049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:01.976977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:01.977251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:01.978022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691, user.id=befc6138692543219697c2205cc4e032) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:01.978331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:01.979769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f6b8-7010-4252-804a-e6f5bf0579b6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:01.985098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 573/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:01 2022] GET /identity/v3/role_assignments?user.id=befc6138692543219697c2205cc4e032&scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691&role.id=a459998da52847ad9ba273f6520dabca => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:03.971586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030253-ff9d-4add-8adf-da4a000eed3b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:03.972117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030253-ff9d-4add-8adf-da4a000eed3b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:03.972223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f030253-ff9d-4add-8adf-da4a000eed3b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:03.973530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 545/1118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:03.978722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:03.979181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:03.979318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:03.997012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:03.998200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:04.015142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:04.064085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 574/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:04.087365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f030253-ff9d-4add-8adf-da4a000eed3b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:04.111368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:04.188104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f030253-ff9d-4add-8adf-da4a000eed3b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:04.221198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:04.221897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:04.222124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:04.222405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] PATH_INFO: `/v3/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:04.223870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] RBAC: Authorizing `identity:get_role(role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:04.225244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:04.226665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 546/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:04 2022] GET /identity/v3/roles/a459998da52847ad9ba273f6520dabca => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:04.232536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:04.330340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf1d3d-d19a-47dc-a07e-4538f7e7fd9d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:04.363472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:04.364942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:04.365231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:04.365513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] PATH_INFO: `/v3/users/befc6138692543219697c2205cc4e032` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:04.366712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] RBAC: Authorizing `identity:get_user(user_id=befc6138692543219697c2205cc4e032)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:04.369592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:04.371693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 575/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:04 2022] GET /identity/v3/users/befc6138692543219697c2205cc4e032 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:04.377553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:04.468497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:04.478636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6dff-b287-4e94-98ee-f3032cae8a1e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:04.513311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:04.513958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:04.514249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:04.514587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:04.515734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:04.517179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac9146-f892-4a9f-9eb0-8186fa13f7df None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:04.518883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 547/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:04 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:04.524860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:04.546749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:04.624637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787490-d377-48cf-b37c-a52ffa907304 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:04.665948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:04.666644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:04.666931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:04.667212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691/users/befc6138692543219697c2205cc4e032/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:04.669382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fe2b099d7c94cb3b8d71be5cab40691, user_id=befc6138692543219697c2205cc4e032, role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:04.670854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a21c1a-e0a9-4c37-9e21-cafdc2b5c681 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:04.683892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 576/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:59:04 2022] PUT /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691/users/befc6138692543219697c2205cc4e032/roles/a459998da52847ad9ba273f6520dabca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:59:06.666528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a7f7-c0d1-45e1-bd14-3966b49f73db None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:06.667079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a7f7-c0d1-45e1-bd14-3966b49f73db None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:06.667079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a7f7-c0d1-45e1-bd14-3966b49f73db None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:06.668451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 548/1124] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:06.673660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:06.674050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:06.674210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:06.691896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:06.693082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:06.759057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 577/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:06.782783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a7f7-c0d1-45e1-bd14-3966b49f73db None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:06.882876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a7f7-c0d1-45e1-bd14-3966b49f73db None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:06.916502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:06.917149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:06.917432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:06.917707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] PATH_INFO: `/v3/roles/a459998da52847ad9ba273f6520dabca` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:06.919181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] RBAC: Authorizing `identity:get_role(role_id=a459998da52847ad9ba273f6520dabca)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:06.920549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:06.921904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 549/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:06 2022] GET /identity/v3/roles/a459998da52847ad9ba273f6520dabca => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:06.927936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:06.939544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:07.026353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbee6ff-237b-4701-9134-2bd0af386e8f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:07.058779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:07.059427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:07.059713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:07.059994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] PATH_INFO: `/v3/users/befc6138692543219697c2205cc4e032` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:07.061169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] RBAC: Authorizing `identity:get_user(user_id=befc6138692543219697c2205cc4e032)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:07.062633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:07.064276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 578/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:06 2022] GET /identity/v3/users/befc6138692543219697c2205cc4e032 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:07.070641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:07.098053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:07.171109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75106c4-b5bc-425b-9459-37c476b85e0f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:07.204943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:07.205561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:07.205848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:07.206130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:07.271443 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:07.272908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:07.298406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:07.370102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 550/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:59:07.376096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:07.459990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:07.481543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8a5f-8d50-48fb-9136-37f52dbb35ca None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:07.516263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:07.516908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:07.517198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:07.517476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] PATH_INFO: `/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:07.518644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] RBAC: Authorizing `identity:get_project(project_id=9fe2b099d7c94cb3b8d71be5cab40691)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:07.520067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04daa5-af6f-41ea-97fd-67fa21d48d26 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:07.521746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 579/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:07 2022] GET /identity/v3/projects/9fe2b099d7c94cb3b8d71be5cab40691 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:07.527941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:07.625154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930be1c-39fd-4376-b263-fe82a0429af3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:07.649857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:07.658358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:07.659015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:07.659297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:07.659577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:07.660358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] RBAC: Adding query filter params (role.id=a459998da52847ad9ba273f6520dabca, scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691, user.id=befc6138692543219697c2205cc4e032) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:07.660672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:07.662105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0f37-de69-4aae-b20c-423ee0731333 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:07.668389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 551/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:07 2022] GET /identity/v3/role_assignments?user.id=befc6138692543219697c2205cc4e032&scope.project.id=9fe2b099d7c94cb3b8d71be5cab40691&role.id=a459998da52847ad9ba273f6520dabca => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:09.713450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802043d-2f67-491d-8474-db4044cda3c2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:09.713982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802043d-2f67-491d-8474-db4044cda3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:09.714098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802043d-2f67-491d-8474-db4044cda3c2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:09.715431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 580/1131] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:09.720714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:09.721165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:09.721281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:09.740176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:09.741306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:09.811932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 552/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:09.834839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802043d-2f67-491d-8474-db4044cda3c2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:09.942503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802043d-2f67-491d-8474-db4044cda3c2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:09.979339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:09.979996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:09.980284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:09.980566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:09.981724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:09.983189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309ff0-924c-43e4-b336-17b0747e92ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:09.984807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 581/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:09.990757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:10.087252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164144-14cf-48f7-98fb-14617c1cf999 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:10.107658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:10.122380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:10.123028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:10.123314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:10.123595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:10.124283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:10.125713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487937-43ef-47dc-91ab-bd4ec47c07db None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:10.151817 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 553/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:59:09 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:59:12.154877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4e25-d6a0-4604-a469-107b17f01b64 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:12.155637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4e25-d6a0-4604-a469-107b17f01b64 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:12.155637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4e25-d6a0-4604-a469-107b17f01b64 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:12.156798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 582/1135] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:12.162074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:12.162581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:12.162681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:12.181566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:12.182789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:12.248738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 554/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:59:12.272600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4e25-d6a0-4604-a469-107b17f01b64 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:12.288184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:12.376932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4e25-d6a0-4604-a469-107b17f01b64 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:12.411841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:12.412399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:12.412680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:12.412965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:12.414689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:12.416113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9f675-e3b3-4e69-ae3c-9d76fe403e45 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:12.417710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 583/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 11:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:12.423891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:12.531034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e314560-8baa-412f-bd71-4ecab1ee1d25 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:12.532659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:12.569667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:12.570304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:12.570625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:12.570908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:12.571611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:12.573060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312e1d-1fe6-4ea9-935a-94dd46721283 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:12.596216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 555/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:59:12 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:59:14.703898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c5f24-7d5a-40a2-ae85-e6660d0c46ee None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:14.704452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c5f24-7d5a-40a2-ae85-e6660d0c46ee None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:14.704452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c5f24-7d5a-40a2-ae85-e6660d0c46ee None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:14.705873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 584/1139] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:14.711922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:14.712385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:14.712562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:14.737830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:14.739077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:14.812450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 556/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:14.836136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c5f24-7d5a-40a2-ae85-e6660d0c46ee None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:14.980027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:15.012752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c5f24-7d5a-40a2-ae85-e6660d0c46ee None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:15.073239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:15.074357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:15.074913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:15.075429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:15.106429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:15.122747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:15.124141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:15.124983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:15.125952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 585/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:59:15.131484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:15.225199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:15.239665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223416c-70fb-4e8c-9b95-d0979e3c6829 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:15.277293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:15.277850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:15.278139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:15.278422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:15.279182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:15.279496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:15.280899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:15.290958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 557/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:15.298907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:15.427021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4f8f8-1930-44d0-848d-8b846c21451f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:15.466476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:15.467165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:15.467447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:15.467730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] PATH_INFO: `/v3/users/b2287427c0e14e95a32979d5ba99f100` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:15.484069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:15.488544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] RBAC: Authorizing `identity:get_user(user_id=b2287427c0e14e95a32979d5ba99f100)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:15.491815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:15.495328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 586/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:15 2022] GET /identity/v3/users/b2287427c0e14e95a32979d5ba99f100 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:15.501156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:15.624298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eed659-ec39-4348-902b-b045e318e2f3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:15.665208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:15.665849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:15.666136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:15.666413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:15.687890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:15.743793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:15.745310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:15.870201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 558/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:59:15.879341 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:15.995347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00997fc1-11a3-4c4a-90f2-00539f916603 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:16.036757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:16.037482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:16.037815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:16.038149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] PATH_INFO: `/v3/projects/496737d9a892469a870c1e05096c3b0b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:16.039479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] RBAC: Authorizing `identity:get_project(project_id=496737d9a892469a870c1e05096c3b0b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:16.040928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2898458-8c0c-4583-b14e-d20675758135 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:16.042725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 587/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:15 2022] GET /identity/v3/projects/496737d9a892469a870c1e05096c3b0b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:16.051744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:16.108499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:16.169630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8d97f-be96-4a52-a910-61201bf0f0dc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:16.207648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:16.208286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:16.208636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:16.208929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:16.209898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=496737d9a892469a870c1e05096c3b0b, user.id=b2287427c0e14e95a32979d5ba99f100) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:16.210241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:16.211802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0502ec5-ed56-4e7c-8493-27b7dc7a4dfc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:16.218814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 559/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:16 2022] GET /identity/v3/role_assignments?user.id=b2287427c0e14e95a32979d5ba99f100&scope.project.id=496737d9a892469a870c1e05096c3b0b&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:18.296697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726b31-277b-4bb0-9c0e-546d6c006ca6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:18.297381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726b31-277b-4bb0-9c0e-546d6c006ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:18.297381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27726b31-277b-4bb0-9c0e-546d6c006ca6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:18.298900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 588/1147] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:18.304838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:18.305342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:18.305511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:18.325673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:18.326918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:18.402478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 560/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:59:18.426059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27726b31-277b-4bb0-9c0e-546d6c006ca6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:18.504052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:18.551527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27726b31-277b-4bb0-9c0e-546d6c006ca6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:18.591812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:18.592592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:18.592886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:18.593158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:18.605338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:18.610746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:18.612579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:18.614263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 589/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:59:18.619581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:18.676357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:18.742715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec459bf-2045-4c66-abd4-009c62b41916 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:18.782471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:18.783211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:18.783498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:18.783783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:18.784608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:18.784985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:18.786596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:18.796820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 561/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:18.807148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:18.949850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029dd57-9d71-428a-92ce-1b2a436250cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:18.998738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:19.010558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:19.011245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:19.011571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:19.012121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] PATH_INFO: `/v3/users/b2287427c0e14e95a32979d5ba99f100` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:19.013485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] RBAC: Authorizing `identity:get_user(user_id=b2287427c0e14e95a32979d5ba99f100)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:19.015247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:19.017018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 590/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:18 2022] GET /identity/v3/users/b2287427c0e14e95a32979d5ba99f100 => generated 286 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:19.023102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:19.136222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860ba4e-73ed-4750-8e28-832ff4f6a6d6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:19.144030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:19.174890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:19.175554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:19.175839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:19.176120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] PATH_INFO: `/v3/projects/496737d9a892469a870c1e05096c3b0b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:19.177404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] RBAC: Authorizing `identity:get_project(project_id=496737d9a892469a870c1e05096c3b0b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:19.178931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e039b9-2488-47e5-82b5-43f997499ede None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:19.180730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 562/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:19 2022] GET /identity/v3/projects/496737d9a892469a870c1e05096c3b0b => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:59:19.187281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:19.305000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148caa4-3930-4470-a8a7-7b9a1497abf4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:19.345190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:19.345870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:19.346150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:19.346429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] PATH_INFO: `/v3/projects/496737d9a892469a870c1e05096c3b0b/users/b2287427c0e14e95a32979d5ba99f100/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:19.348548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=496737d9a892469a870c1e05096c3b0b, user_id=b2287427c0e14e95a32979d5ba99f100, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:19.350017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e016a2-276c-4d94-8a81-c85d0b97faf5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:19.367005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 591/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:59:19 2022] PUT /identity/v3/projects/496737d9a892469a870c1e05096c3b0b/users/b2287427c0e14e95a32979d5ba99f100/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 11:59:21.549272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beba9-6337-4c24-985b-bf1228cdce94 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:21.549826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beba9-6337-4c24-985b-bf1228cdce94 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:21.549826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beba9-6337-4c24-985b-bf1228cdce94 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:21.551284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 563/1154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:21.559359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:21.559872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:21.560058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:21.586206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:21.588295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:21.661680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:21.683786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 592/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:21.707714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358beba9-6337-4c24-985b-bf1228cdce94 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:21.838234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358beba9-6337-4c24-985b-bf1228cdce94 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:21.875079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:21.875735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:21.876024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:21.876304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:21.888929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:21.893968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:21.896021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:59:21.897780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 564/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:59:21.902598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:22.007574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258b29-ae45-43af-9c58-119cc8632635 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:22.045261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:22.045898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:22.046190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:22.046499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:22.047223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:22.047560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:22.048934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:22.058703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 593/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:59:22.064682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:22.103298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:22.183958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1922bbf-4815-4ffb-aff0-53978f146032 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:22.229387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:22.230401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:22.230927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:22.231367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] PATH_INFO: `/v3/users/b2287427c0e14e95a32979d5ba99f100` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:22.233003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] RBAC: Authorizing `identity:get_user(user_id=b2287427c0e14e95a32979d5ba99f100)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:22.235308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:22.237616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 565/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:22 2022] GET /identity/v3/users/b2287427c0e14e95a32979d5ba99f100 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:22.243971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:22.298725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:22.357182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43020c-c85b-49f2-be29-4d4e307e85b3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:22.393785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:22.394425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:22.394745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:22.395017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:22.469238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:22.470770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:22.530363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:22.593639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 594/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:59:22.600037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:22.708006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8286aeb-f11c-460d-968c-155890cce27b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:22.709557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:22.745226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:22.745878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:22.746164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:22.746468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] PATH_INFO: `/v3/projects/496737d9a892469a870c1e05096c3b0b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:22.747738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] RBAC: Authorizing `identity:get_project(project_id=496737d9a892469a870c1e05096c3b0b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:22.749271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87ec5a-8812-49fa-8ae8-87967473fe1d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:22.751139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 566/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:22 2022] GET /identity/v3/projects/496737d9a892469a870c1e05096c3b0b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:22.758156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:22.863367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba33a-19a3-4b61-8b23-616c0a3a3b34 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:22.901589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:22.902696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:22.903205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:22.903711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:22.905255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=496737d9a892469a870c1e05096c3b0b, user.id=b2287427c0e14e95a32979d5ba99f100) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:22.905645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:22.907547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3d976-7f63-4bec-866e-de0f9ef0c9cd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:22.915886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 595/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:22 2022] GET /identity/v3/role_assignments?user.id=b2287427c0e14e95a32979d5ba99f100&scope.project.id=496737d9a892469a870c1e05096c3b0b&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:25.016758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296efe-ee48-49d3-a561-1f0f616bbc55 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:25.017373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296efe-ee48-49d3-a561-1f0f616bbc55 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:25.017373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296efe-ee48-49d3-a561-1f0f616bbc55 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:25.018732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 567/1162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:25.024146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:25.024614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:25.024713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:25.043190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:25.044389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:25.052345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:25.118600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 596/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:25.142305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296efe-ee48-49d3-a561-1f0f616bbc55 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:25.250756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296efe-ee48-49d3-a561-1f0f616bbc55 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:25.286863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:25.287410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:25.287696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:25.287983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:25.329471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:25.364351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:25.365825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:25.477028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 568/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:59:25.483715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:25.603789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08fea-1f01-423d-83b8-89db509b4c42 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:25.652235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:25.653001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:25.653373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:25.653821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:25.662396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:25.664163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c34dfcb2-94e7-481a-9ae7-91cc1cc6da0f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:25.677659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:25.679001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:25.680222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 597/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 11:59:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 11:59:25.686417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:25.764933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:25.799124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1af58-daa7-43d1-af5c-b17862665845 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:25.834808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:25.835992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:25.836281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:25.836560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:25.837247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:25.837556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:25.838993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e308-b15e-473b-9cc7-ba7212e6d5b7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:25.846488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 569/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 3 11:59:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:27.886616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441feb-6981-4238-998a-c3b10d735dcc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:27.887611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441feb-6981-4238-998a-c3b10d735dcc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:27.887611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441feb-6981-4238-998a-c3b10d735dcc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:27.889642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 598/1167] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:27.895347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b999-ea13-453e-8d13-4d07dcaeee19 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:27.896102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b999-ea13-453e-8d13-4d07dcaeee19 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:27.896276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b999-ea13-453e-8d13-4d07dcaeee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:27.916207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0742b999-ea13-453e-8d13-4d07dcaeee19 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:27.917409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0742b999-ea13-453e-8d13-4d07dcaeee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:27.988325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 570/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:28.017429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441feb-6981-4238-998a-c3b10d735dcc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:28.021189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:28.128610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441feb-6981-4238-998a-c3b10d735dcc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:28.165262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:28.165814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:28.166100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:28.166379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:28.167139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:28.168521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809a0f1-0436-4f63-b439-b65432909088 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:28.185077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 599/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Aug 3 11:59:28 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:59:30.300821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f98359-eb1c-4bf3-b062-2b59bbecb043 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:30.301412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f98359-eb1c-4bf3-b062-2b59bbecb043 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:30.301658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f98359-eb1c-4bf3-b062-2b59bbecb043 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:30.303515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 571/1170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:30.309062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:30.309497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:30.309611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:30.329189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:30.330506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:30.392999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:30.406046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 600/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:30.430357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f98359-eb1c-4bf3-b062-2b59bbecb043 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:30.499485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:30.545092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f98359-eb1c-4bf3-b062-2b59bbecb043 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:30.585382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:30.586038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:30.586334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:30.586653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] PATH_INFO: `/v3/domains/24203c0f21234f869bb8ebab3b4edf09` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:30.598515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24203c0f21234f869bb8ebab3b4edf09)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:30.600262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08e817-bf76-42ef-a352-9245338d3c56 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:30.602254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 572/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 3 11:59:30 2022] GET /identity/v3/domains/24203c0f21234f869bb8ebab3b4edf09 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:30.608719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:30.724178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acd641-ce6e-4417-9afd-b2356db515fc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:30.761388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:30.762277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:30.762597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:30.762880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:30.763576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:30.765008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeca411-acfa-451f-88d2-52c351665c7c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:30.793871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 601/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 11:59:30 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 11:59:32.976472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c55b1-7950-498b-8c64-ce75d52f706b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:32.977304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c55b1-7950-498b-8c64-ce75d52f706b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:32.977304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c55b1-7950-498b-8c64-ce75d52f706b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:32.978394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 573/1174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:32.984035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:32.984557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:32.984659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:33.003663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:33.004889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:33.048089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:33.078140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 602/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 11:59:33.103769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c55b1-7950-498b-8c64-ce75d52f706b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:33.236626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c55b1-7950-498b-8c64-ce75d52f706b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:33.267262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:33.281583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:33.282405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:33.282727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:33.283013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] PATH_INFO: `/v3/domains/24203c0f21234f869bb8ebab3b4edf09` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:33.284208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=24203c0f21234f869bb8ebab3b4edf09)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:33.286162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d9d0c-5f26-4e61-9716-73bd104a1f0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:33.288352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 574/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 3 11:59:33 2022] GET /identity/v3/domains/24203c0f21234f869bb8ebab3b4edf09 => generated 267 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:59:33.294905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:33.402054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914614fc-efcd-437e-8186-5eac13c752eb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:33.436841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:33.437466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:33.437756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:33.438045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:33.438786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:33.440234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488499cb-778f-4165-97d3-cf116998d6d4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:33.465415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 603/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 11:59:33 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 11:59:35.569859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440870-364f-4c3c-917c-5604199c8e1f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:35.570501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440870-364f-4c3c-917c-5604199c8e1f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:35.570501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440870-364f-4c3c-917c-5604199c8e1f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:35.571830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 575/1178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 11:59:35.578418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:35.578952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:35.579311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:35.604436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:35.605864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:35.642395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:35.698136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 604/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:35.721982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7440870-364f-4c3c-917c-5604199c8e1f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:35.830375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7440870-364f-4c3c-917c-5604199c8e1f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:35.867789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:35.868485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:35.868900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:35.869309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:35.882642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:35.889024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:35.890153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:59:35.891094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 576/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:59:35.902773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:36.020819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c8808-3e17-4b40-9286-00ce549a4b1e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:36.071101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:36.071735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:36.072019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:36.072297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:36.073023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:36.073390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:36.074921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:36.084710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 605/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:36.092970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:36.160386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:36.221246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319047b-4c68-43cb-a74a-9d640496d701 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:36.257606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:36.258264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:36.258583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:36.258868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] PATH_INFO: `/v3/users/1087ec8f62994457acab0d2e38a6b69d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:36.274259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] RBAC: Authorizing `identity:get_user(user_id=1087ec8f62994457acab0d2e38a6b69d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:36.275873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:36.277673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 577/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:36 2022] GET /identity/v3/users/1087ec8f62994457acab0d2e38a6b69d => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:36.286300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:36.314249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:36.400131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28240a1-324f-475c-82f9-554eeefdfcc1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:36.438556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:36.439332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:36.439622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:36.439925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:36.521350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:36.522940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:36.549136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:36.636217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 606/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 11:59:36.642874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:36.755531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9275a4-a91c-47e0-b748-6bc0fb7b8f71 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:36.768583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:36.794742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:36.795401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:36.795708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:36.795975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] PATH_INFO: `/v3/projects/41f0882364524ecc8e647b7bf7b6473d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:36.797161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0882364524ecc8e647b7bf7b6473d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:36.798664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c508d-f046-43cb-b244-7eda53968584 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:36.800387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 578/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:36 2022] GET /identity/v3/projects/41f0882364524ecc8e647b7bf7b6473d => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:36.811376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:36.919614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11844-7318-4b45-9618-304801b4cdf6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:36.949600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:36.963325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:36.963946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:36.964225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:36.964499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:36.965362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=41f0882364524ecc8e647b7bf7b6473d, user.id=1087ec8f62994457acab0d2e38a6b69d) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:36.965702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:36.967375 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9658-e2c1-476b-9bc9-30706efce562 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:36.973465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 607/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:36 2022] GET /identity/v3/role_assignments?user.id=1087ec8f62994457acab0d2e38a6b69d&scope.project.id=41f0882364524ecc8e647b7bf7b6473d&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:39.108027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cff4d-a1ad-4e4b-a883-8ed8695063fc None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.108579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cff4d-a1ad-4e4b-a883-8ed8695063fc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.108579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cff4d-a1ad-4e4b-a883-8ed8695063fc None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.109925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 579/1186] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:39.115589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.116741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.116904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.135970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:39.137442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:39.219914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 608/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:39.243103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cff4d-a1ad-4e4b-a883-8ed8695063fc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:39.364844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cff4d-a1ad-4e4b-a883-8ed8695063fc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:39.403270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:39.403933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.404220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.404499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.416523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:39.421901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:39.423174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 11:59:39.424033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 580/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:59:39.429467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:39.534363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1e82c-fbed-4c1b-996f-96797d8f5fab None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:39.552472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:39.570878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:39.571516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.571799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.572074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.572801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:39.573109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:39.574530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:39.584040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 609/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:39.590491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:39.632478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:39.699681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f778c-ee23-463a-9108-9e8a0ec2f548 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:39.739315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:39.739977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.740266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.740552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] PATH_INFO: `/v3/users/1087ec8f62994457acab0d2e38a6b69d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.741772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] RBAC: Authorizing `identity:get_user(user_id=1087ec8f62994457acab0d2e38a6b69d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:39.743263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:39.744911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 581/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:39 2022] GET /identity/v3/users/1087ec8f62994457acab0d2e38a6b69d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:39.750711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:39.858473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104990-ca5f-45cc-b610-36d907d22170 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:39.892929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:39.893507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:39.893789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:39.894072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] PATH_INFO: `/v3/projects/41f0882364524ecc8e647b7bf7b6473d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:39.895278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] RBAC: Authorizing `identity:get_project(project_id=41f0882364524ecc8e647b7bf7b6473d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:39.896709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28202b39-2da5-405c-9bc2-df2f4cd058dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:39.899138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 610/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:39 2022] GET /identity/v3/projects/41f0882364524ecc8e647b7bf7b6473d => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:39.905257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:40.007054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a09f-96b6-42df-8235-986900fcf77c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:40.014617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:40.052573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:40.053251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:40.053567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:40.053853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] PATH_INFO: `/v3/projects/41f0882364524ecc8e647b7bf7b6473d/users/1087ec8f62994457acab0d2e38a6b69d/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:40.055812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f0882364524ecc8e647b7bf7b6473d, user_id=1087ec8f62994457acab0d2e38a6b69d, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:40.057262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7b449-67af-4209-a23e-927583fe96f8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:40.070312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 582/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 11:59:39 2022] PUT /identity/v3/projects/41f0882364524ecc8e647b7bf7b6473d/users/1087ec8f62994457acab0d2e38a6b69d/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 11:59:42.032144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0085e-dd7a-4e2b-b248-a29782c5cccf None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.032708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0085e-dd7a-4e2b-b248-a29782c5cccf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.032708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0085e-dd7a-4e2b-b248-a29782c5cccf None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.034046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 611/1193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 11:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 11:59:42.040422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.040935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.041022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.059840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 11:59:42.061060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 11:59:42.137564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 583/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 11:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 11:59:42.162405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0085e-dd7a-4e2b-b248-a29782c5cccf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:42.215727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:42.269522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0085e-dd7a-4e2b-b248-a29782c5cccf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:42.302424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:42.303020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.303373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.303681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.314865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 11:59:42.320323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 11:59:42.321425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 11:59:42.322488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 11:59:42.326597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 612/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 11:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 11:59:42.327706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:42.419414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:42.425925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1cfe-809b-4892-9209-5d0b1ae9dc45 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:42.464798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:42.465493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.465778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.466058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.466825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:42.467139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:42.468561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:42.477069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 584/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 11:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:42.483011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:42.581164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a6b6-da1c-4208-8a31-83a34051a944 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:42.587862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:42.614518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:42.615160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.615442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.615719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] PATH_INFO: `/v3/users/1087ec8f62994457acab0d2e38a6b69d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.617393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] RBAC: Authorizing `identity:get_user(user_id=1087ec8f62994457acab0d2e38a6b69d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:42.618843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:42.620473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 613/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 3 11:59:42 2022] GET /identity/v3/users/1087ec8f62994457acab0d2e38a6b69d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:42.626298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:42.724440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7a2b-3551-4d91-a55e-b72ff752ff65 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:42.760000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:42.761053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:42.761488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:42.761768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:42.796794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:42.836868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:42.838262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:42.934344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 585/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 11:59:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 11:59:42.940265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:43.046680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4dbec-8bf1-4dc7-a21c-cc4d128ce1aa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:43.081494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:43.082163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:43.082471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:43.082763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] PATH_INFO: `/v3/projects/41f0882364524ecc8e647b7bf7b6473d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:43.084024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] RBAC: Authorizing `identity:get_project(project_id=41f0882364524ecc8e647b7bf7b6473d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:43.085537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6ca28-ac82-41bf-a147-d4b1c6c60df8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:43.092933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 614/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 3 11:59:42 2022] GET /identity/v3/projects/41f0882364524ecc8e647b7bf7b6473d => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 11:59:43.093811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 11:59:43.157429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:43.199916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649215-17a7-4450-a55c-5c38811307af None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 11:59:43.235162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 11:59:43.235785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 11:59:43.236071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 11:59:43.236352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 11:59:43.237139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=41f0882364524ecc8e647b7bf7b6473d, user.id=1087ec8f62994457acab0d2e38a6b69d) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 11:59:43.237454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 11:59:43.238961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f3efc-cdb4-4f96-ab56-35f598bac125 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 11:59:43.245192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 586/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 11:59:43 2022] GET /identity/v3/role_assignments?user.id=1087ec8f62994457acab0d2e38a6b69d&scope.project.id=41f0882364524ecc8e647b7bf7b6473d&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 11:59:53.077234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=79 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 11:59:53.242221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=39 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:39.888081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f617-ec96-4b84-abe7-e58e61195f4d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:39.888705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f617-ec96-4b84-abe7-e58e61195f4d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:39.888705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f617-ec96-4b84-abe7-e58e61195f4d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:39.890249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 615/1201] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:00:39.897975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:39.898605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:39.898931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:39.918469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:00:39.919992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:00:40.024993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 587/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:00:40.058264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5f617-ec96-4b84-abe7-e58e61195f4d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:40.242334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5f617-ec96-4b84-abe7-e58e61195f4d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:40.290782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:40.291513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:40.291802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:40.292080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:40.304903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:40.306568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:40.326499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:40.335459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:40.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:40.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:40.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:40.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:40.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 616/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:40.337637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:40.503319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9073d2-aeb2-440c-8a34-54297614c375 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:40.548533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:40.556609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:40.557274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:40.557568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:40.557890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:40.559219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:40.559769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:40.561863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127e430-3a63-43fa-b3eb-39af08af68e7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:40.583557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 588/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:40.595663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:40.685095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:40.757873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94432eb-fac5-4d40-913b-978ca5367f25 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:40.815414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:40.816613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:40.817173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:40.817173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:40.817904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:40.819423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2a7c7-332a-4b0a-a556-597cd3ec65f5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:40.858471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 617/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 3 12:00:40 2022] POST /identity/v3/users => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:00:43.100643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5a09-0794-4644-972b-c86e485ed71d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:43.102406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5a09-0794-4644-972b-c86e485ed71d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:43.102406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5a09-0794-4644-972b-c86e485ed71d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:43.102893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 589/1206] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:00:43.108555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:43.109066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:43.109173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:43.130550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:00:43.131797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:00:43.209826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 618/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:00:43.234331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5a09-0794-4644-972b-c86e485ed71d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:43.381041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5a09-0794-4644-972b-c86e485ed71d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:43.427556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:43.428302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:43.428681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:43.428835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:43.442292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:00:43.447521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:43.448523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:43.449359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 590/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 12:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:43.456636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:43.510891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:43.592878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223d1e-4f5c-4332-a8ad-c06841514a47 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:43.633585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:43.634150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:43.634431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:43.634870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:43.635602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:43.635964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:43.637560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:43.651543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 619/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 12:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:43.652579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:43.711374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:43.767963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09ffd-c9f0-45a3-9416-efa81f118ecf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:43.808210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:43.809057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:43.809336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:43.809687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:43.825067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:43.827918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:43.846097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:43.847341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:43.848844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:43.848844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:43.848844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:43.848844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:43.848844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 591/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:43.855276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:43.977866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:43.981591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f01f4-41db-476e-bce0-bcfc64a7a881 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:44.023376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:44.024204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:44.024477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:44.024888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:44.025654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:44.025991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:44.027565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:44.045590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 620/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:44.047309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:44.173555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee65ae9-6b29-433d-bcef-c6ccca7ac9d6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:44.176045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:44.214861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:44.215547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:44.215834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:44.216112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:44.226774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:44.228490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:00:44.241395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:44.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:44.243841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:44.249715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 592/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:44.250714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:44.390537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69305-a0d2-4fb7-9a06-ff5dc7162711 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:44.429927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:44.430627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:44.430992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:44.431212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:44.432043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:44.432441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:44.434002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:44.459513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:44.460373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 621/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:00:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:44.596142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429004f-9bd3-4ea7-bb8e-6344ee08e9d8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:44.642789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:44.643475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:44.643758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:44.644034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:44.696053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:44.745390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:44.747002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:44.902059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 593/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 12:00:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:00:44.903585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:44.925601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:45.025912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ccd2d-2475-4b40-b7a2-f1d2cd7605a6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:45.077889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:45.078891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:45.079184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:45.079467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:45.094188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:45.096095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:45.121307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:45.122313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:45.123894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:45.123894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:45.123894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:45.123894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:45.123894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 622/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:00:45.129255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:45.203841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:45.249823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c409b6-e3cc-4f2e-b7e1-760c40ede3e6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:45.292133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:45.292774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:45.293073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:45.293380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:45.294097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:45.294433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:45.295857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:45.308267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 594/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:45.313608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:45.406395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:45.455872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885bd0a-4b84-4e2a-98ac-f006982d3faa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:45.532241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:45.533838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:45.534396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:45.535072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:45.545758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:45.547456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:00:45.561127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:45.572189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:45.574662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 623/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:45.577933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:45.697419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ff22-650a-4d21-9f3c-f69e1383dfac None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:45.721958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:45.741433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:45.742093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:45.742382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:45.742752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:45.743758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:45.744087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:45.745699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a9de-4e62-40ef-8424-f39bd487faf5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:45.760317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 595/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:45.767586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:45.891749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec223a0-ba1d-489b-b452-3df90b6b7f8d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:45.930182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:45.937986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:45.938914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:45.939334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:45.939743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:45.940740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=3848fce2cc0541499c45dee60acec543) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:45.941170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:45.943476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa42bf-862f-4083-b428-a578c3c7680c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:45.951417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 624/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 12:00:45 2022] GET /identity/v3/role_assignments?user.id=3848fce2cc0541499c45dee60acec543&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:48.124054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c962-821a-4a5c-98e7-e5ffbea8c49d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:48.124683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c962-821a-4a5c-98e7-e5ffbea8c49d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:48.124683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c962-821a-4a5c-98e7-e5ffbea8c49d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:48.125991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 596/1220] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:00:48.132653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:48.133248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:48.133248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:48.153733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:00:48.155197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:00:48.240782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 625/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:00:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:00:48.276554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12c962-821a-4a5c-98e7-e5ffbea8c49d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:48.393373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12c962-821a-4a5c-98e7-e5ffbea8c49d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:48.432091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:48.432780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:48.433126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:48.433400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:48.445867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:00:48.450831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:48.452174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:48.453035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 597/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 12:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:48.460170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:48.584008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9285-ddc3-4565-b7dd-1ffa2d2b3e33 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:48.613806 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:48.631715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:48.632824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:48.633345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:48.633835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:48.635173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:48.637482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:48.640104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:48.660537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 626/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 12:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:48.662215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:48.712489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:48.774162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c9362-8f37-4432-8129-dbb4868398d1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:48.818264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:48.819013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:48.819298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:48.819594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:48.832306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:48.834573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:48.850110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:48.851249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:48.852291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:48.852291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:48.852291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:48.852291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:48.852291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 598/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:48.857590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:48.977828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6509f6b-0c81-4d1c-9e44-982283a6af70 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.019907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.021557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.022018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.022548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.023856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:49.024382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.027080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.045906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 627/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:49.053300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:49.175069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:49.184183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6f2a-05b0-4f34-96cc-ff87d01a226c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.222606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.223301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.223649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.223983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.233241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.234867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:00:49.248352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:49.249598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:49.250616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 599/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:49.256124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:49.314584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:49.372410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eafad-af45-41a5-85c6-2073e59f8ec3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.412023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.412645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.413005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.413280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.414134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:49.414464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.415914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.434220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 628/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:49.440098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:49.561729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba1904-76bc-47a9-8f87-2bd0b8a16861 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.599255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.599921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.600197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.600479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.611918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.613405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:49.628810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:49.629889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:49.630884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:49.630884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:49.630884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:49.630884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:49.630884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 600/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:49.636077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:49.742595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e21fbf-1d06-4934-849c-3c9726dfa49a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.745600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:49.781866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.782544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.782830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.783107 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.783853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:49.784166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.785625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.799232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 629/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:49.806155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:49.816689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:49.922211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628d211-6852-4715-b5f7-af51442a762d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:49.962166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:49.962860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:49.963148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:49.963464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:49.972258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:49.974311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:00:49.987453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:49.988858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:49.990106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 601/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:49.995307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:50.107034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe561-8998-466c-b776-1e486a7a9daa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:50.146316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:50.147139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:50.147406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:50.147681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:50.148506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:50.148835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:50.150391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef2d9-da9a-4e61-a8a5-a20d8e619b03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:50.164244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 630/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:50.170856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:50.243331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:50.283774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ed663-d040-4d5c-ad02-df90fb9f67f8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:50.322697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:50.323390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:50.323675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:50.324010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/3848fce2cc0541499c45dee60acec543/roles/1e11ef2e2e794dc8ad3fad9ee1e74674` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:50.342403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=3848fce2cc0541499c45dee60acec543, role_id=1e11ef2e2e794dc8ad3fad9ee1e74674)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:50.343915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c6ec-82d1-48b9-92c1-79953c78d23b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:50.356732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 602/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 12:00:50 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/3848fce2cc0541499c45dee60acec543/roles/1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:00:52.454012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb9bf-b0ab-4270-aa6f-9aa791dd6831 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:52.454589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb9bf-b0ab-4270-aa6f-9aa791dd6831 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:52.454684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeb9bf-b0ab-4270-aa6f-9aa791dd6831 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:52.455989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 631/1233] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:00:52.462142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:52.462742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:52.462857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:52.483404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:00:52.484645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:00:52.579953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 603/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:00:52.605133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeb9bf-b0ab-4270-aa6f-9aa791dd6831 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:52.632974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:52.715321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeb9bf-b0ab-4270-aa6f-9aa791dd6831 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:52.752748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:52.753372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:52.753714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:52.753931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:52.765282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:00:52.770531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:52.771614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:52.772807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 632/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 3 12:00:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:52.778057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:52.830555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:52.901366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e6af-7fe9-4348-bdf9-59585c460091 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:52.940054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:52.940852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:52.941227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:52.941604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:52.942568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:52.942972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:52.944724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:52.954717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 604/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 3 12:00:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:52.961165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:53.051995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:53.069768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ef09-80f0-4118-820e-cc9032c1b4cb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:53.104144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:53.104787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:53.105072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:53.105354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:53.115565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:53.117059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:53.132372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:53.133464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:53.134498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:53.134498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:53.134498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:53.134498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:53.134498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 633/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:53.140008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:53.247590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950880c4-9e63-485c-8e2c-2a529a6dcb37 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:53.257195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:53.287652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:53.288373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:53.288731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:53.289010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:53.289809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:53.290125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:53.291677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:53.307014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 605/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:53.313120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:53.447014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11490-30c3-49c2-8c00-f77bf43bcfc8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:53.486412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:53.487080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:53.487369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:53.487652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:53.490836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:53.496434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:53.498256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:00:53.511963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:53.513478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:53.514751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:53.520947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 634/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:53.521151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:53.672316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24e4d-a1a8-410b-ba41-f60a297115f0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:53.715466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:53.716357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:53.716737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:53.717173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:53.718170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:53.718651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:53.720678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:53.743860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 606/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:00:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:00:53.749883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:53.879452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0012d-a614-4f7d-a84d-bf9c3b77048e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:53.917736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:53.918367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:53.918759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:53.919024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:53.991464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:53.999361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:54.001105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:54.128601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 635/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 12:00:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:00:54.134934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:54.170760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:54.261909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9b14-3de8-40b7-a5c2-def7a13d76a1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:54.305327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:54.306375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:54.306892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:54.307275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:54.319375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:54.321199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:54.337531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:54.338806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:54.341262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:54.341262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:54.341262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:54.341262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:54.341262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 607/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:54.344573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:54.464618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:54.472921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3be8e-814b-4bae-ba28-1883fd9bfa30 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:54.514015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:54.514949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:54.515434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:54.515920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:54.516915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:54.517598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:54.519642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:54.538376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 636/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:54.546383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:54.659528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:54.687792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d3d1b-5023-42be-81a7-0c52f10e2276 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:54.727556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:54.728204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:54.728545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:54.728825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:54.736284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:54.737833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:00:54.749547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:54.755769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:54.756803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 608/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:54.757436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:54.887684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39271c2-d978-49d3-9e96-8f31f9a40d7d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:54.930047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:54.930737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:54.931029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:54.931340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:54.932140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:54.932446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:54.933917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df95be-a225-414f-89d6-ddf7179bac1f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:54.948207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 637/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:00:54.954928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:55.084091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f2a7-61d3-4515-aa43-18c5ab74052f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:55.124887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:55.125559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:55.125833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:55.126147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:55.126953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] RBAC: Adding query filter params (role.id=1e11ef2e2e794dc8ad3fad9ee1e74674, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=3848fce2cc0541499c45dee60acec543) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:55.127272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:55.128701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72df45-4f19-4627-bc84-5728665a5760 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:55.137843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 609/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 12:00:54 2022] GET /identity/v3/role_assignments?user.id=3848fce2cc0541499c45dee60acec543&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=1e11ef2e2e794dc8ad3fad9ee1e74674 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:00:57.445550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fe8f-6e10-41ec-8f24-c821a450cafe None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:57.446266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fe8f-6e10-41ec-8f24-c821a450cafe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:57.446266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fe8f-6e10-41ec-8f24-c821a450cafe None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:57.447523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 638/1247] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:00:57.453418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:57.454199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:57.454199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:57.460891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:57.474532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:00:57.475866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:00:57.604938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 610/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:00:57.656554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5fe8f-6e10-41ec-8f24-c821a450cafe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:57.681932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:57.804805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5fe8f-6e10-41ec-8f24-c821a450cafe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:57.852761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:57.853558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:57.853903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:57.854182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:57.869334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:00:57.875599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:57.877838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:57.879489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 639/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 12:00:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:57.886217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:58.040343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a6f7b-4c06-413d-9213-cd477916b9d3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:58.089368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:58.097345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:58.098587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:58.098977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:58.099325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:58.100358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:58.100873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:58.102476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:58.114979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 611/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 12:00:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:58.121952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:58.239231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:58.285362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b309-c544-4453-bd9e-73cf3d0836c1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:58.332306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:58.333677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:58.334072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:58.334544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:58.350011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:58.352191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:58.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:58.375562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:58.376643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:58.376643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:58.376643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:58.376643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:58.376643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 640/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:58.383091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:58.528741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4528-64e0-41de-9041-186f39481233 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:58.578828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:58.579504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:58.579790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:58.580133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:58.580929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:58.581297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:58.583332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:58.598071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 612/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:58.603770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:58.734659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836140a-3c10-4ced-98dc-6873905784b0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:58.773389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:58.783627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:58.784485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:58.784732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:58.785051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:58.795754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:58.797686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:00:58.812133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:58.814066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:00:58.816069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 641/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:00:58.822132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:58.900892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:58.956634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adca5a6-6e56-46d8-9d05-11a62792b936 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:59.006293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:59.006973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:59.007259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:59.007654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:59.008365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:59.008682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:59.010176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:59.041912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 613/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:00:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:00:59.046051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:59.202410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d613fa-737c-453e-b8b9-1ae3e9ceddd6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:59.243517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:59.244157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:59.244450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:59.244725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:59.320868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:59.340837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:59.343116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:59.494393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 642/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 12:00:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:00:59.501609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:59.659459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815610e-2919-453b-90ee-43756ccf1bb8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:59.681015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:59.712720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:59.713395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:59.713679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:59.713950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:59.726961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:59.728532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:00:59.747117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:00:59.748395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:00:59.749323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:00:59.749323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:00:59.749323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:00:59.749323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:00:59.749323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 614/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:00:59.754758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:00:59.882628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:00:59.901953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2537a-cdf6-4a6e-b36f-fa99fed72589 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:00:59.951658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:00:59.952397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:00:59.952752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:00:59.953074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:00:59.953853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:00:59.954158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:00:59.955648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:00:59.970027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 643/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:00:59.977930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:00.123036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b90b8a-26f1-460a-a75b-6078e0e86786 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:00.172972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:00.174002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:00.174509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:00.174987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:00.186892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:00.189581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:01:00.204321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:00.206964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:00.208596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 615/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:00.213731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:00.342234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8977-a116-4f06-aada-17db0f081caf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:00.383595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:00.384176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:00.384387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:00.384657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:00.385475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:00.385792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:00.387573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1d627-580b-4855-8f9c-a296a289ada4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:00.402118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 644/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:01:00.409693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:00.455485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:00.564252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e6024-c290-41fc-b3cf-6a20daf9f538 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:00.614815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:00.615561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:00.615900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:00.616190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:00.617202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=3848fce2cc0541499c45dee60acec543) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:00.617612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:00.619333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce4c56-1c0c-49db-84db-8fb87b4e2057 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:00.646575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 616/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 12:01:00 2022] GET /identity/v3/role_assignments?user.id=3848fce2cc0541499c45dee60acec543&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:01:02.983366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2d9c-5cff-42e9-8b4d-4a68ce377888 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:02.984197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2d9c-5cff-42e9-8b4d-4a68ce377888 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:02.984401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2d9c-5cff-42e9-8b4d-4a68ce377888 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:02.985852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 645/1261] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:02.992535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:02.993146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:02.993146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:03.013480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:03.014762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:03.098617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 617/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:03.122679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2d9c-5cff-42e9-8b4d-4a68ce377888 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:03.138663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:03.279385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2d9c-5cff-42e9-8b4d-4a68ce377888 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:03.343593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:03.344655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:03.345162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:03.345677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:03.367426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:01:03.377657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:03.379434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:03.381382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 646/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 12:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:03.388682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:03.420861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:03.546662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280e3a-de0e-4b3a-b039-7fc5a179b81c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:03.584400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:03.585079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:03.585442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:03.585765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:03.586591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:03.586987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:03.588545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:03.599150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 618/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 12:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:01:03.605457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:03.680733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:03.717305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013efec-871b-40d6-b92f-444dccab2087 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:03.756168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:03.756908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:03.757258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:03.757576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:03.771254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:03.772768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:01:03.791486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:03.792956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:03.794682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:01:03.794682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:01:03.794682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:03.794682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:03.794682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 647/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:03.799305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:03.900703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:03.926245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb481-11d7-40b5-a344-521aad9ac0bd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:03.998255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:03.999353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:03.999842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:04.000318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:04.001482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:04.001976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:04.005114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:04.028514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 619/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:04.034560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:04.155314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6962454-d1ab-4197-b3cd-dbf7835a2c48 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:04.177722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:04.193352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:04.194010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:04.194297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:04.194621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:04.202532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:04.203976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:01:04.215351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:04.221674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:04.222878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 648/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:01:04.223605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:04.329051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477818c-66f0-4f71-a46d-d38dcfa481cd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:04.364325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:04.365004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:04.365329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:04.365647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:04.366510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:04.366863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:04.368352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:04.378020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:04.389918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 620/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:01:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:04.395878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:04.521174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb4bc4-495b-4fdc-b9c3-030299065871 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:04.580886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:04.581866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:04.582348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:04.582817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:04.602421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:04.605286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:01:04.634348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:04.635600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:04.636689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:01:04.636689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:01:04.636689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:04.636689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:04.637038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 649/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:01:04.643092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:04.754074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed102-baf8-4056-83a0-a273663adc24 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:04.793399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:04.794036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:04.794326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:04.794639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:04.795333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:04.795644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:04.797045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:04.809773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 621/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:04.818946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:04.871678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:04.989097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0afd-b4e6-4880-ab5d-089ae5f5b476 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:05.048133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:05.049118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:05.049443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:05.049810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:05.057798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:05.059324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:01:05.071390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:05.072505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:05.073807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 650/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:05.078780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:05.142431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:05.191767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33e40-8811-470d-b774-db6f382068dd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:05.227310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:05.227944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:05.228231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:05.228513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:05.229266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:05.229579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:05.231061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e938d-ef02-490c-bfae-faa3eb73db44 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:05.243598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 622/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:05.249674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:05.348028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:05.357797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ff23-244c-4e59-9f35-5703e6bb526f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:05.396179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:05.396876 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:05.397161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:05.397437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] PATH_INFO: `/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/3848fce2cc0541499c45dee60acec543/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:05.399461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] RBAC: Authorizing `identity:create_grant(project_id=c965b4a154874b4082f263ae870a9bc5, user_id=3848fce2cc0541499c45dee60acec543, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:05.400917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f858-73cc-4cde-9d2a-0ad914fc900e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:05.414968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 651/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 3 12:01:05 2022] PUT /identity/v3/projects/c965b4a154874b4082f263ae870a9bc5/users/3848fce2cc0541499c45dee60acec543/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:01:07.417310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c7ce-f15e-4698-8907-73065f5d97cd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:07.417906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c7ce-f15e-4698-8907-73065f5d97cd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:07.417906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c7ce-f15e-4698-8907-73065f5d97cd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:07.419307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 623/1274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:07.424509 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:07.424933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:07.425071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:07.444005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:07.445185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:07.520079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 652/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:07.552154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c7ce-f15e-4698-8907-73065f5d97cd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:07.656544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c7ce-f15e-4698-8907-73065f5d97cd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:07.685252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:07.702531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:07.703179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:07.703470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:07.703753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:07.713851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:01:07.718813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:07.719911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:07.720928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 624/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 3 12:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:07.726574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:07.807756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:07.826362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcb16f-0af3-4be2-a10f-9b5483fe1961 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:07.861421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:07.862043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:07.862328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:07.862626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:07.863335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:07.864178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:07.865529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:07.873734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 653/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 3 12:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:07.879577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:07.986623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c169203-578c-4a13-af05-93682bfd6829 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:08.023261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:08.023927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:08.024214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:08.024493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:08.036653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:08.038156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:01:08.054596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:08.055719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:08.056901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:01:08.056901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:01:08.056901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:08.056901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:08.056901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 625/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:08.061896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:08.165072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83603254-9c6a-4eb0-9754-59fb87cd8f61 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:08.198168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:08.198816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:08.199096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:08.199370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:08.200057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:08.200355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:08.201715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:08.213767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 654/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:08.219514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:08.258945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:08.329734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126058c-1e0b-4c88-9e9f-ad44de5296dd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:08.363709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:08.364349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:08.364639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:08.364919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:08.373305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:08.374791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:01:08.386707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:08.388137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:08.393948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 626/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:08.394705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:08.398460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:08.499840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889c9a-603a-4208-9792-934eadfa68cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:08.534187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:08.534780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:08.535066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:08.535356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:08.536142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:08.536453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:08.537873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:08.555241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 655/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 3 12:01:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:08.560994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:08.651536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:08.661503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c262-407e-42ea-a672-278a97821b4e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:08.695258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:08.695870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:08.696194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:08.696475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:08.761789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:08.763528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:08.851488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:08.861824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 627/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 3 12:01:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:01:08.868166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:08.929815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:08.968728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936d3e-91b2-4f15-93fb-d431826a36f2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:09.002416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:09.003146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:09.003432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:09.003709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:09.014487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:09.015940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:01:09.030400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:09.031369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:09.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:01:09.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:01:09.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:01:09.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:09.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 656/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:09.038746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:09.140290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bccc2-387f-455d-9c69-32a88e015f64 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:09.173279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:09.173897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:09.174181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:09.174485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:09.175170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:09.175476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:09.177486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:09.188899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 628/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 3 12:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:09.194642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:09.291114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925adf-fc79-4e8e-be22-c457bef560ba None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:09.308329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:09.328167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:09.328813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:09.329101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:09.329381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:09.335981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:09.337424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:01:09.349221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:09.350256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Aug 03 12:01:09.351372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 657/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 3 12:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:09.356269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:09.408417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:09.458049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1610-2033-4cec-8480-257466fdf9da None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:09.497585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:09.498221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:09.498538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:09.498822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:09.499585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:09.499896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:09.501340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a200b-fcf1-4fbd-8a64-34961f7d8e2b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:09.514065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 629/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 3 12:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:09.520737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:09.618682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9c88-168e-4772-84eb-b45ab569e812 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:09.652931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:09.653769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:09.654053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:09.654329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:09.655344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] RBAC: Adding query filter params (role.id=b8b7263c1aac4d76b5376b2c9f7962d8, scope.project.id=c965b4a154874b4082f263ae870a9bc5, user.id=3848fce2cc0541499c45dee60acec543) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:09.655803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:09.657333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c45a4a-1812-495b-9376-36a2cff62303 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:09.665886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 658/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 3 12:01:09 2022] GET /identity/v3/role_assignments?user.id=3848fce2cc0541499c45dee60acec543&scope.project.id=c965b4a154874b4082f263ae870a9bc5&role.id=b8b7263c1aac4d76b5376b2c9f7962d8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:11.704284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9ef3-7186-47a8-b1b4-74cf4c1b042a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:11.704810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9ef3-7186-47a8-b1b4-74cf4c1b042a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:11.704926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9ef3-7186-47a8-b1b4-74cf4c1b042a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:11.706254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 630/1288] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:11.712049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:11.712489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:11.712597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:11.732652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:11.733759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:11.762827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:11.800036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 659/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:11.821717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9ef3-7186-47a8-b1b4-74cf4c1b042a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:11.921145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9ef3-7186-47a8-b1b4-74cf4c1b042a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:11.932335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:11.954884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:11.955519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:11.955805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:11.956082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:11.956700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:11.958621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:11.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:11.968598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:11.969670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 631/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 12:01:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:11.975214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:12.073671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3909c-6355-49a1-9b0f-2dee07d55ce4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:12.106494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:12.107113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:12.107396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:12.107674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:12.108338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:12.108646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:12.110026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56288765-c56d-43af-a48f-eb2cdcfeda3d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:12.115812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 660/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 3 12:01:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:12.122349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:12.221371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68cb7-537c-49af-843a-cacce98b1c30 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:12.254667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:12.255282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:12.255565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:12.255842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:12.256503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:12.256808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:12.258178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a20da3-dc3a-4df4-aa93-1c6020e698e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:12.262799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 632/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 3 12:01:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:14.277541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d790-3033-4258-b33e-449ea7ced6e3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:14.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d790-3033-4258-b33e-449ea7ced6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:14.278158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d790-3033-4258-b33e-449ea7ced6e3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:14.279558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 661/1293] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:14.285461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7206f53-6abe-4d4e-84df-6541ad8b80bc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:14.286012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7206f53-6abe-4d4e-84df-6541ad8b80bc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:14.286012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7206f53-6abe-4d4e-84df-6541ad8b80bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:14.305836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d7206f53-6abe-4d4e-84df-6541ad8b80bc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:14.307136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d7206f53-6abe-4d4e-84df-6541ad8b80bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:14.340694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:14.378776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 633/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:14.402428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d790-3033-4258-b33e-449ea7ced6e3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:14.434163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:14.529308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d790-3033-4258-b33e-449ea7ced6e3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:14.570753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:14.571381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:14.571664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:14.571939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:14.572636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:14.574040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a8c49-53d0-4aea-ad02-057c6d577df1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:14.590071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 662/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 3 12:01:14 2022] POST /identity/v3/services => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:01:16.627849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860227a-b384-4ede-9b6c-2a0c785b5bf9 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:16.628415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860227a-b384-4ede-9b6c-2a0c785b5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:16.628415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860227a-b384-4ede-9b6c-2a0c785b5bf9 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:16.630315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 634/1296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:16.635816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:16.636330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:16.636419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:16.656656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:16.657892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:16.733306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 663/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:16.755811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860227a-b384-4ede-9b6c-2a0c785b5bf9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:16.861035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860227a-b384-4ede-9b6c-2a0c785b5bf9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:16.901413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:16.902086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:16.902374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:16.902683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:16.903335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:16.904766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:16.914792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:16.915997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:16.917307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 635/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 12:01:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:16.922390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:16.943815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:17.038747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43971a5-083d-4aad-a028-3fe37e8d9441 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:17.074310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:17.074962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:17.075247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:17.075522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:17.076195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:17.076501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:17.077877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:17.083092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 664/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 3 12:01:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:17.089134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:17.122205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:17.193358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f55fc-0929-475f-842f-6617bed3cc08 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:17.240968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:17.241599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:17.241887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:17.242168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:17.242961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] RBAC: Adding query filter params (interface=public, service_id=901926925de74dfc9f57789378b4683f, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:17.243280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:17.244664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc9a2-3aa7-48db-934b-e694fd552105 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:17.249723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 636/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 3 12:01:17 2022] GET /identity/v3/endpoints?service_id=901926925de74dfc9f57789378b4683f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:17.256044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:17.338361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:17.357329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73cd40-3416-46ab-b9db-3c98ae7cc55b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:17.391929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:17.392550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:17.392832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:17.393108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:17.393760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:17.395150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555f4c-20be-4ee8-8a19-caaf58ed0e00 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:17.401973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 665/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 3 12:01:17 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:01:19.442312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a957c-5877-42b0-a27d-61d625f1b95f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:19.443037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a957c-5877-42b0-a27d-61d625f1b95f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:19.443037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a957c-5877-42b0-a27d-61d625f1b95f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:19.444284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 637/1302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:01:19.450871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:19.451390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:19.451975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:19.477224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:01:19.478733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:01:19.560607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 666/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:01:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:01:19.584258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a957c-5877-42b0-a27d-61d625f1b95f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:19.688795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:19.701539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a957c-5877-42b0-a27d-61d625f1b95f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:19.736713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:19.737352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:19.737637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:19.737910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:19.738616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:19.739989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:01:19.749417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:01:19.750706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: ERROR keystone.server.flask.application Aug 03 12:01:19.751562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 638/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 3 12:01:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:01:19.757472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:19.837959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:19.862069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a483e-163b-4e96-8e1d-94fd2e22e655 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:19.897412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:19.898031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:19.898322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:19.898644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:19.899326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:01:19.899640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:19.901011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d190043-78c5-412d-a773-ba1126782ed6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:19.906203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 667/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 3 12:01:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:01:19.912742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:01:20.013569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3caac-0487-46fd-b7e3-3f351ec9adb0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:01:20.056550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:01:20.057180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:01:20.057469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:01:20.057750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:01:20.058497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:01:20.059888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c2ae3-48ff-4bb8-82f8-a360a0531042 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:01:20.079749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 639/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:01:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:01:29.903138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=30 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:01:30.075123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:27.685117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4195-2fa2-4038-8bea-2879a7cb4b5f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:27.685677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4195-2fa2-4038-8bea-2879a7cb4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:27.685677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be4195-2fa2-4038-8bea-2879a7cb4b5f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:27.695007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729d55-3f18-4d10-9a51-03d4006411d3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:27.695458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729d55-3f18-4d10-9a51-03d4006411d3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:27.695969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17729d55-3f18-4d10-9a51-03d4006411d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:27.697103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 668/1307] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:27.792144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-17729d55-3f18-4d10-9a51-03d4006411d3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:27.794146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-17729d55-3f18-4d10-9a51-03d4006411d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:27.981941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 640/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:28.037061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:28.037344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:28.037802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:28.039466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 669/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 3 12:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:28.059129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153590c-fcac-49bd-bf62-5651107f8246 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:28.059668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153590c-fcac-49bd-bf62-5651107f8246 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:28.060142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153590c-fcac-49bd-bf62-5651107f8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:28.278887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f153590c-fcac-49bd-bf62-5651107f8246 None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:28.281212 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f153590c-fcac-49bd-bf62-5651107f8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:28.358436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:28.491519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 641/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 3 12:02:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:28.502945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:28.504974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:28.761561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20984-b529-42f5-ad09-1273970ff3c8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:28.920728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:28.922078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:28.922681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:28.923243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:28.927153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:29.038475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:29.168843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:29.172111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c9cc2-e0a9-40d1-a842-ec92207d2450 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:29.216580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 670/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:31.640068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:31.640929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:31.641077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:31.644573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 642/1312] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:31.652678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ee6-f053-49a9-bed0-1fe8c0c5928c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:31.653369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ee6-f053-49a9-bed0-1fe8c0c5928c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:31.653369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ee6-f053-49a9-bed0-1fe8c0c5928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:31.749210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-72af2ee6-f053-49a9-bed0-1fe8c0c5928c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:31.750357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-72af2ee6-f053-49a9-bed0-1fe8c0c5928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:31.879752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 671/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:02:31.921241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:31.922853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:32.054890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2b0a9-d482-4ec6-a347-086a421d6784 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:32.152344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:32.156051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:32.158925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:32.158925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:32.162251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:32.165759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:32.287070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:32.288536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297e8b1-ead2-4158-af29-ca08fec6dcba service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:32.308053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 643/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:34.732176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e64c-f2cd-4866-9934-fd473850c48d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:34.732710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e64c-f2cd-4866-9934-fd473850c48d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:34.732710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e64c-f2cd-4866-9934-fd473850c48d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:34.734183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 672/1315] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:34.740309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35514-2458-4c34-bb96-9eaafa2f94ef None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:34.740904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35514-2458-4c34-bb96-9eaafa2f94ef None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:34.740904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35514-2458-4c34-bb96-9eaafa2f94ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:34.811207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5cd35514-2458-4c34-bb96-9eaafa2f94ef None None] MFA Rules not processed for user `b5fd614718af4cdba982df4dd3b59b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:34.812439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5cd35514-2458-4c34-bb96-9eaafa2f94ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:34.867560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:34.920130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 644/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:34.975401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:34.975869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:34.976280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:34.978687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 673/1317] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 3 12:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:34.985549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc358d2-fbff-4f07-aa67-ef793540fa29 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:34.985797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc358d2-fbff-4f07-aa67-ef793540fa29 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:34.986151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc358d2-fbff-4f07-aa67-ef793540fa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:35.076609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ddc358d2-fbff-4f07-aa67-ef793540fa29 None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:35.077833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ddc358d2-fbff-4f07-aa67-ef793540fa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:35.159169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 645/1318] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 3 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:02:35.168412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:35.169949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:35.179917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:35.275783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d09e04-943b-4892-94a2-7efcd7ea80da None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:35.350395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:35.351041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:35.351323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:35.351600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:35.353254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:35.417134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:35.466811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:35.468251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e25d-354d-48f4-ab60-604011eb28f7 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:35.488108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 674/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:02:38.541983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:38.542679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:38.542679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:38.543968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 646/1320] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:38.549811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372827f-f0e1-47a1-a81c-7082ef86e145 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:38.550371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372827f-f0e1-47a1-a81c-7082ef86e145 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:38.550371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372827f-f0e1-47a1-a81c-7082ef86e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:38.644775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b372827f-f0e1-47a1-a81c-7082ef86e145 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:38.647025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b372827f-f0e1-47a1-a81c-7082ef86e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:38.763339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 675/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:38.802653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:38.804482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:38.855967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:38.927008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e266a56-72e5-4db7-945b-4745a90d0b9e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:39.007343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:39.007972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:39.008257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:39.008542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:39.010198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:39.111617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:39.125932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:39.127977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800533bc-acbc-49f8-b053-0056a0a3e094 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:39.148239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 647/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:42.097956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:42.098518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:42.098645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:42.100099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 676/1323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:42.106323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5023a-56ae-4031-b264-92e59a7f122e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:42.107071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5023a-56ae-4031-b264-92e59a7f122e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:42.107345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5023a-56ae-4031-b264-92e59a7f122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:42.181484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1fd5023a-56ae-4031-b264-92e59a7f122e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:42.182751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1fd5023a-56ae-4031-b264-92e59a7f122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:42.286833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 648/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:42.350786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:42.353780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:42.392949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:42.508505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f7e9-8bf4-4e27-b8a6-e9e50c9ccd23 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:42.592401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:42.593039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:42.593324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:42.593602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:42.595338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:42.680347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:42.723222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:42.724673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1451ed5-c0a5-4041-b212-f4ed4c66faf0 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:42.745189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 677/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:44.885237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:44.885798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:44.885798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:44.887207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 649/1326] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:44.893378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d91c6-7b02-4ae3-af65-00958aeadd46 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:44.893827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d91c6-7b02-4ae3-af65-00958aeadd46 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:44.893949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d91c6-7b02-4ae3-af65-00958aeadd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:44.961513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b47d91c6-7b02-4ae3-af65-00958aeadd46 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:44.962659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b47d91c6-7b02-4ae3-af65-00958aeadd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:45.061798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 678/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:45.099977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:45.101663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:45.165864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:45.214091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a209-d7cd-43b0-a318-06d65a48cb6b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:45.289894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:45.290548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:45.290835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:45.291113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:45.292741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:45.410818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:45.413559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:45.415428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2714e-dc0a-4139-882b-9e8e80aa4b9a service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:45.434531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 650/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:47.541324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:47.541877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:47.541877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:47.543577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 679/1329] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:47.549297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989282bd-f597-48e9-a037-e0265f35bede None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:47.549852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989282bd-f597-48e9-a037-e0265f35bede None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:47.549942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989282bd-f597-48e9-a037-e0265f35bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:47.619746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-989282bd-f597-48e9-a037-e0265f35bede None None] MFA Rules not processed for user `b5fd614718af4cdba982df4dd3b59b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:47.620984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-989282bd-f597-48e9-a037-e0265f35bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:47.723698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 651/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:47.761970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:47.763858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:47.795970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:47.878001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c107-14f3-433a-b768-0df5a39fa39d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:47.952554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:47.953182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:47.953470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:47.953750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:47.955442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:48.036092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:48.072858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:48.074314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597302f-b902-4432-9ed6-20b37429b52a service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:48.092252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 680/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:50.368407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:50.368857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:50.368975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:50.370354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 652/1332] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:50.375883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920508-7241-47ee-8f47-ae07d0df66d9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:50.376897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920508-7241-47ee-8f47-ae07d0df66d9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:50.376993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920508-7241-47ee-8f47-ae07d0df66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:50.443710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-31920508-7241-47ee-8f47-ae07d0df66d9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:50.444953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-31920508-7241-47ee-8f47-ae07d0df66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:50.542284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 681/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:02:50.578962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:50.581043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:50.650912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:50.697329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8413-8306-43be-8315-9637a8b09198 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:50.778623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:50.779171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:50.779454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:50.779732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:50.781383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:50.898395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:50.899795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44450-a705-4adc-bc12-3aad913164d5 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:50.910013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:50.919068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 653/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:53.034435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:53.035034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:53.035034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:53.036453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 682/1335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:53.041684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cd04-fe49-4794-9c55-4f4cc91d1f82 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:53.042091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cd04-fe49-4794-9c55-4f4cc91d1f82 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:53.042250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cd04-fe49-4794-9c55-4f4cc91d1f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:53.108855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8f84cd04-fe49-4794-9c55-4f4cc91d1f82 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:53.110073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8f84cd04-fe49-4794-9c55-4f4cc91d1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:53.205996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 654/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:53.245968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:53.247561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:53.289049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:53.352946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1379dd-772e-4557-9b9b-11a2286a6696 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:53.426642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:53.427262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:53.427548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:53.427827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:53.429478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:53.523061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:53.550045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:53.551454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24011b3-eb83-4cf7-a4ba-fae16bb796e3 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:53.569582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 683/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:02:55.936257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:55.936840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:55.936840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:55.938200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 655/1338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:02:55.943642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45556-ec1a-42a5-b134-d7f31fa9cd9a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:55.944087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45556-ec1a-42a5-b134-d7f31fa9cd9a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:55.944198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b45556-ec1a-42a5-b134-d7f31fa9cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:56.013280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b3b45556-ec1a-42a5-b134-d7f31fa9cd9a None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:02:56.014553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b3b45556-ec1a-42a5-b134-d7f31fa9cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:56.114031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 684/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:02:56.151432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:02:56.153054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:56.233695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:02:56.262333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eabbd-ce6c-4ba3-82cd-d0c88241d6c2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:02:56.336812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:02:56.337424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:02:56.337705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:02:56.337980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:02:56.339663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:02:56.448236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:02:56.449691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1133d71-3ca3-4874-bc3a-e0b48a1d78c3 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:02:56.468462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 656/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:02:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:00.472617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:00.473219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:00.473219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:00.474560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 685/1341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:00.480020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f622-b017-4a9d-96e0-c31ad8e8344a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:00.481337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f622-b017-4a9d-96e0-c31ad8e8344a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:00.482093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f622-b017-4a9d-96e0-c31ad8e8344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:00.490017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:00.557644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4c33f622-b017-4a9d-96e0-c31ad8e8344a None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:00.558907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4c33f622-b017-4a9d-96e0-c31ad8e8344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:00.664200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 657/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:00.704570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:00.706281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:00.757227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:00.820232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028fbe-14ba-4f62-9ee4-d44a9693a627 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:00.899975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:00.900615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:00.900906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:00.901253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:00.903382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:01.012929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:01.030750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:01.032212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d416-7477-4194-8cda-12eb305162aa service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:01.052746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 686/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:03.782724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:03.783329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:03.783329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:03.784774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 658/1344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:03.790769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf6b8-857f-4fa6-bc79-f6435a556ad5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:03.791522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf6b8-857f-4fa6-bc79-f6435a556ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:03.791522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf6b8-857f-4fa6-bc79-f6435a556ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:03.885220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c69cf6b8-857f-4fa6-bc79-f6435a556ad5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:03.886570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c69cf6b8-857f-4fa6-bc79-f6435a556ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:03.992482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 687/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:04.029943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:04.031518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:04.126330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:04.147092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5220-e40d-4291-b31b-9b8aa3c3eb19 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:04.225816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:04.226354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:04.227074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:04.227074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:04.228724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:04.354645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:04.356082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0fc4a-2254-4cf5-90c4-1f46adf3192d service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:04.374421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 659/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:08.968812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:08.969343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:08.969436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:08.970850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 688/1347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:08.977298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5718-cd44-4c99-8c7d-6b57efc9af61 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:08.977805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5718-cd44-4c99-8c7d-6b57efc9af61 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:08.977899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e5718-cd44-4c99-8c7d-6b57efc9af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:08.995042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:09.056141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-813e5718-cd44-4c99-8c7d-6b57efc9af61 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:09.057391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-813e5718-cd44-4c99-8c7d-6b57efc9af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:09.170005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 660/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:09.208781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:09.210312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:09.272770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:09.322820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fae28-24cd-45a6-9e5d-c0c7b90f89d3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:09.404447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:09.405073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:09.405356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:09.405632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:09.407832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:09.528363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:09.533042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:09.534794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e444f3-0714-4211-ab40-d17f87cba3a7 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:09.554399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 689/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:14.580796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dc4b-d88e-4870-92b7-83d52b8e719c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:14.581308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dc4b-d88e-4870-92b7-83d52b8e719c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:14.581390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dc4b-d88e-4870-92b7-83d52b8e719c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:14.583017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 661/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:14.590537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f084-4d4e-4946-8296-b41981b36673 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:14.590956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f084-4d4e-4946-8296-b41981b36673 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:14.592230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f084-4d4e-4946-8296-b41981b36673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:14.705414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9618f084-4d4e-4946-8296-b41981b36673 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:14.712748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9618f084-4d4e-4946-8296-b41981b36673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:14.862143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 690/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:19.168034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=59 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:19.171507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7bb6-8613-4c5a-b4ac-fd85b6061e1a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:19.173060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7bb6-8613-4c5a-b4ac-fd85b6061e1a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:19.174166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7bb6-8613-4c5a-b4ac-fd85b6061e1a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:19.176240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 662/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:03:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:19.181616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0007c0-8e02-4999-8cfb-30e4e4e8f1f1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:19.182119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0007c0-8e02-4999-8cfb-30e4e4e8f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:19.182374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0007c0-8e02-4999-8cfb-30e4e4e8f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:19.240736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:19.268955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0a0007c0-8e02-4999-8cfb-30e4e4e8f1f1 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:19.270357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0a0007c0-8e02-4999-8cfb-30e4e4e8f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:19.409097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 691/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:20.638521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe774b-e1cc-4233-8f1b-24b0253a3e84 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:20.639092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe774b-e1cc-4233-8f1b-24b0253a3e84 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:20.639092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe774b-e1cc-4233-8f1b-24b0253a3e84 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:20.640431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 663/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:20.646066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305059f7-60b4-4a90-af59-5a1a7afba3cc None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:20.646521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305059f7-60b4-4a90-af59-5a1a7afba3cc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:20.646825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305059f7-60b4-4a90-af59-5a1a7afba3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:20.727548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-305059f7-60b4-4a90-af59-5a1a7afba3cc None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:20.728762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-305059f7-60b4-4a90-af59-5a1a7afba3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:20.771421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:20.838650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 692/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:24.244149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f54-6b71-482b-94c1-eb72091dac9c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:24.244680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f54-6b71-482b-94c1-eb72091dac9c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:24.244795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f54-6b71-482b-94c1-eb72091dac9c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:24.246081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 664/1356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:24.252343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d81e1-631d-417a-8770-685b057a003f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:24.252900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d81e1-631d-417a-8770-685b057a003f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:24.252900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d81e1-631d-417a-8770-685b057a003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:24.350246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-159d81e1-631d-417a-8770-685b057a003f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:24.351993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-159d81e1-631d-417a-8770-685b057a003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:24.487171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 693/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:24.538936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:24.539587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:24.540185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:24.542074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 665/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 3 12:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:24.556065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b66c-7ab7-4f82-88a8-9524fd9cd9de None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:24.556424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b66c-7ab7-4f82-88a8-9524fd9cd9de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:24.556671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b66c-7ab7-4f82-88a8-9524fd9cd9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:24.581953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:24.660833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ab87b66c-7ab7-4f82-88a8-9524fd9cd9de None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:24.661997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ab87b66c-7ab7-4f82-88a8-9524fd9cd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:24.829178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 694/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 3 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:24.837149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:24.838698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:25.002303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfdaa5-4f4e-485a-8e4f-f2acd3971fd7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:25.089058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:25.136338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:25.137061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:25.137419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:25.138100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:25.139846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:25.240240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:25.241866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef81f2d-6104-46c5-b54c-dd7f92983661 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:25.267235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 666/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:27.514868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:27.515478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:27.515478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:27.517404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 695/1361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:27.525724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6925-1b0d-4bbb-94c1-88d49f1e7908 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:27.526224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6925-1b0d-4bbb-94c1-88d49f1e7908 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:27.526502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6925-1b0d-4bbb-94c1-88d49f1e7908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:27.603508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f2cb6925-1b0d-4bbb-94c1-88d49f1e7908 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:27.604674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f2cb6925-1b0d-4bbb-94c1-88d49f1e7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:27.646365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:27.713362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 667/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:27.779322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:27.781401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:27.887993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.058476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f028-5ed7-4a31-9d3a-631326d13746 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:28.192273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:28.192906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:28.193194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:28.193475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:28.195203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:28.234157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.317096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:28.319468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd02f1-02e9-48c7-a0d5-4f3e08bca7a5 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:28.341411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 696/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:31.001415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097240c-395a-485a-949b-4b92f422fe5d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:31.002322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097240c-395a-485a-949b-4b92f422fe5d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:31.002777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097240c-395a-485a-949b-4b92f422fe5d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:31.004326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 668/1364] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:31.009911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5e9a-8efb-4c8d-95ed-8348013ea308 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:31.010901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5e9a-8efb-4c8d-95ed-8348013ea308 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:31.011472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5e9a-8efb-4c8d-95ed-8348013ea308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:31.089352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d8ae5e9a-8efb-4c8d-95ed-8348013ea308 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:31.090754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d8ae5e9a-8efb-4c8d-95ed-8348013ea308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:31.202300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:31.209783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 697/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:31.255033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:31.255235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:31.255514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:31.256872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 669/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 3 12:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:31.263436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba1e-c103-41ee-8c08-67e7664672e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:31.263820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba1e-c103-41ee-8c08-67e7664672e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:31.264166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ba1e-c103-41ee-8c08-67e7664672e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:31.345561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-40a5ba1e-c103-41ee-8c08-67e7664672e8 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:31.346915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-40a5ba1e-c103-41ee-8c08-67e7664672e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:31.495319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 698/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 3 12:03:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:31.504623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:31.506223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:31.673445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd626-ff9f-4039-b7a9-2bd48c98315e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:31.695211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:31.817800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:31.818353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:31.818651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:31.818940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:31.820607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:31.937534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:31.939190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974024aa-5ddb-42a9-ae78-3d3844aeed87 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:31.960191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 670/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:32.921015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73055d5-4bf7-457f-aa6f-fce821aeeeb2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:32.921593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73055d5-4bf7-457f-aa6f-fce821aeeeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:32.922618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73055d5-4bf7-457f-aa6f-fce821aeeeb2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:32.925469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 699/1369] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:03:32.931201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273de16-2173-481f-aeb9-095e8ba47234 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:32.931687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273de16-2173-481f-aeb9-095e8ba47234 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:32.931974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273de16-2173-481f-aeb9-095e8ba47234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:32.967562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:33.013372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f273de16-2173-481f-aeb9-095e8ba47234 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:33.014938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f273de16-2173-481f-aeb9-095e8ba47234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:33.166820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 671/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:33.518100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:33.518389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:33.518699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:33.520570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 700/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 3 12:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:33.525295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ff38-8171-40ec-a002-2c1bd8849987 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:33.525589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ff38-8171-40ec-a002-2c1bd8849987 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:33.525873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ff38-8171-40ec-a002-2c1bd8849987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:33.610807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-efa9ff38-8171-40ec-a002-2c1bd8849987 None None] MFA Rules not processed for user `acea16a4c33b4d5e96889f5600c35666`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:33.612300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-efa9ff38-8171-40ec-a002-2c1bd8849987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:33.672996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:33.708204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 672/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 3 12:03:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:33.716772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:33.718314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:33.775074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:33.835631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8cf3-17d1-4165-ad8e-f4693bc03846 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:33.915895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:33.916559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:33.916873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:33.917191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:33.919072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:34.050579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:34.067788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:34.069678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e24f39-fe67-4192-985b-85709786e8a3 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:34.093993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 701/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:34.523278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:34.524148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:34.524730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:34.529052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 673/1374] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:34.534407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e7b1-d301-4c7c-82b0-3e26e1884106 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:34.534729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e7b1-d301-4c7c-82b0-3e26e1884106 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:34.535023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e7b1-d301-4c7c-82b0-3e26e1884106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:34.608317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-71a9e7b1-d301-4c7c-82b0-3e26e1884106 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:34.610414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-71a9e7b1-d301-4c7c-82b0-3e26e1884106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:34.739018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 702/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:34.786391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:34.788948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:34.974233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8886c-6e70-423b-b4a0-7fef176b405f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:35.034153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:35.098351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:35.099002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:35.099284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:35.099562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:35.101203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:35.213417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:35.215252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b01d4-f66e-474b-97b4-35219783ad7f service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:35.235794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 674/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:37.347380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:37.348212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:37.348212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:37.349200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 703/1377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:37.354662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9eb9d-7385-4230-b0f3-f28efa768e15 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:37.355161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9eb9d-7385-4230-b0f3-f28efa768e15 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:37.355257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9eb9d-7385-4230-b0f3-f28efa768e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:37.430401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-76d9eb9d-7385-4230-b0f3-f28efa768e15 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:37.431647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-76d9eb9d-7385-4230-b0f3-f28efa768e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:37.439079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:37.545945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 675/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:37.591140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:37.592675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:37.659911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:37.790112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5049-1329-4551-a35a-497d818ceb48 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:37.932625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:37.933153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:37.933441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:37.933726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:37.935393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:37.955350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:38.043660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:38.045490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd670-e767-40e5-a735-8c49ac5c36b8 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:38.067376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 704/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:40.163063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:40.163727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:40.163727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:40.165219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 676/1380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:40.170726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed569ce-1421-4162-908b-d8294085075d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:40.171407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed569ce-1421-4162-908b-d8294085075d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:40.171407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed569ce-1421-4162-908b-d8294085075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:40.248993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bed569ce-1421-4162-908b-d8294085075d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:40.250186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bed569ce-1421-4162-908b-d8294085075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:40.370555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:40.386611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 705/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:40.436284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:40.438095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:40.628769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:40.644460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a813fc-ce45-4f07-ab32-edda6577d924 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:40.825301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:40.825933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:40.826223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:40.826540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:40.828828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:40.932235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:40.933828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b78bf-cbdc-4f05-bcee-b5c6e636cf64 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:40.947396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:40.959261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 677/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:43.027035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:43.028099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:43.028099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:43.028968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 706/1383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:03:43.034715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846ed2-e694-4481-8b51-3cfe596eaa82 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:43.035489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846ed2-e694-4481-8b51-3cfe596eaa82 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:43.035489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846ed2-e694-4481-8b51-3cfe596eaa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:43.108605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-71846ed2-e694-4481-8b51-3cfe596eaa82 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:43.109861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-71846ed2-e694-4481-8b51-3cfe596eaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:43.230912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 678/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:43.273117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:43.274682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:43.431106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7635-8a83-4e30-bb79-9a4327ab39dc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:43.512915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:43.563288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:43.563909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:43.564197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:43.564480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:43.566115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:43.667772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:43.669394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d40199-f894-4011-9d7e-4efd7de3f184 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:43.691637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 707/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:46.124568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:46.125135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:46.125135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:46.127886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 679/1386] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:46.134558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8a77-ef13-4098-bc72-d6c4f82f34ed None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:46.135060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8a77-ef13-4098-bc72-d6c4f82f34ed None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:46.135288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8a77-ef13-4098-bc72-d6c4f82f34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:46.230203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b14b8a77-ef13-4098-bc72-d6c4f82f34ed None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:46.233005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b14b8a77-ef13-4098-bc72-d6c4f82f34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:46.284966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:46.361036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 708/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:46.416966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:46.418494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:46.505250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:46.582742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85118f0d-05a6-4d9f-964d-f91ff86de737 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:46.745013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:46.745729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:46.746095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:46.746721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:46.749697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:46.808642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:46.868252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:46.869901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82e5e-7d1f-41ef-9d5d-911d220999ac service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:46.890181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 680/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:49.066087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.066708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.066708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.068062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 709/1389] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:49.073381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e938d-78e9-42f7-9d16-39834d503270 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.074041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e938d-78e9-42f7-9d16-39834d503270 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.074041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e938d-78e9-42f7-9d16-39834d503270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.146326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-037e938d-78e9-42f7-9d16-39834d503270 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:49.147611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-037e938d-78e9-42f7-9d16-39834d503270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:49.253483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 681/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:49.298879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:49.300439 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:49.451144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff670-4713-4b23-81eb-34215156e290 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:49.469179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:49.478101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66f75-3874-495c-b015-13cdedf93313 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.478399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66f75-3874-495c-b015-13cdedf93313 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.479667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66f75-3874-495c-b015-13cdedf93313 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.480651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 682/1391] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:03:49.487047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0039d-dac8-47dc-9c7a-b1b5ab2527d9 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.487345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0039d-dac8-47dc-9c7a-b1b5ab2527d9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.487630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0039d-dac8-47dc-9c7a-b1b5ab2527d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.503480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:49.556960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f8e0039d-dac8-47dc-9c7a-b1b5ab2527d9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:49.558180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f8e0039d-dac8-47dc-9c7a-b1b5ab2527d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:49.575541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:49.576162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.576453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.576734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.579020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:49.660100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 683/1392] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:49.670358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:49.672005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd446f94-0bb3-4ea1-bfbb-cf59f9a9f3b4 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:49.691163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 710/1393] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:49.716615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.716948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.717188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.718580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 684/1394] 10.222.0.17 () {54 vars in 966 bytes} [Wed Aug 3 12:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:49.724205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476f3e-0a12-41c7-b6dd-87f9f0134fc7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:49.724563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476f3e-0a12-41c7-b6dd-87f9f0134fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:49.724939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476f3e-0a12-41c7-b6dd-87f9f0134fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:49.755149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:49.817417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-95476f3e-0a12-41c7-b6dd-87f9f0134fc7 None None] MFA Rules not processed for user `07fbf4cc412649fba94ad020f6221b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:49.818688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-95476f3e-0a12-41c7-b6dd-87f9f0134fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:49.911507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 711/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Wed Aug 3 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:49.919195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:49.920725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:50.037487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:50.048574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308fd44-f232-49f1-ae73-4550d7d34dc9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:50.131199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:50.133714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:50.134150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:50.134558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:50.136791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:50.256131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:50.257593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165a447-a32a-42f5-b4d4-c9b6ebbe7a13 service glance] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:50.277136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 685/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:03:51.040193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17343-78e1-4780-a01d-e2a131a74a76 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.040681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17343-78e1-4780-a01d-e2a131a74a76 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.040894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17343-78e1-4780-a01d-e2a131a74a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.107523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d6c17343-78e1-4780-a01d-e2a131a74a76 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:51.108737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d6c17343-78e1-4780-a01d-e2a131a74a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:51.171200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:51.203426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 712/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:51.255050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.255605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.255605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.257130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 686/1398] 10.222.0.17 () {54 vars in 943 bytes} [Wed Aug 3 12:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:51.263670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f75cde-0026-463a-b1dd-aa89713b4bdd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.263959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f75cde-0026-463a-b1dd-aa89713b4bdd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.264289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f75cde-0026-463a-b1dd-aa89713b4bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.345601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a0f75cde-0026-463a-b1dd-aa89713b4bdd None None] MFA Rules not processed for user `d55ffdc3893f45e0881043a7b10857b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:51.346657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a0f75cde-0026-463a-b1dd-aa89713b4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:51.463459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 713/1399] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Aug 3 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:51.473633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:51.475332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:51.499838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:51.615968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c531ab-642d-4ff7-87b5-81ebaccb4e2a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:51.725461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:51.726092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.726384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.726692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.728393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:51.735930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:51.773566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b98c6-9a06-4e83-ba85-c2813ddba6a4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.774062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b98c6-9a06-4e83-ba85-c2813ddba6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.774579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b98c6-9a06-4e83-ba85-c2813ddba6a4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.776604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 714/1400] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:03:51.784022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf607ef-a337-4fd9-9f03-75a1fd5b0a6b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:51.784311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf607ef-a337-4fd9-9f03-75a1fd5b0a6b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:51.784594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf607ef-a337-4fd9-9f03-75a1fd5b0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:51.831331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:51.831594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:51.833273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:51.842055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 687/1401] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:03:51.854562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fcf607ef-a337-4fd9-9f03-75a1fd5b0a6b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:51.855788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fcf607ef-a337-4fd9-9f03-75a1fd5b0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:51.969873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 715/1402] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:52.015096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:52.017094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:52.120648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800f1b-df58-4382-825a-bec4154e7835 service swift] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:52.189319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:52.260296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:52.261008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:52.261264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:52.261545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:52.263521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:52.364558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:52.366209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024455f-d33f-40ae-97bf-09d4ec5a7e52 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:52.386544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 688/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:54.582993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:54.583603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:54.583603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:54.584953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 716/1404] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:54.590480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5764-ae90-466b-9461-aa4ee1da17a0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:54.590991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5764-ae90-466b-9461-aa4ee1da17a0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:54.591080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5764-ae90-466b-9461-aa4ee1da17a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:54.666374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-968f5764-ae90-466b-9461-aa4ee1da17a0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:54.667689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-968f5764-ae90-466b-9461-aa4ee1da17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:54.686249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:54.777849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 689/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:03:54.823431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:54.824961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:54.980565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:55.021863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b00d9-463d-4ec9-992c-2f7a87cea3cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:55.154814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:55.155362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:55.155650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:55.156246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:55.157718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:55.247466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:55.262091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:55.266259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd637c8d-534f-4727-bf58-d3acb063579f service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:55.287321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 717/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:03:57.379588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:57.380148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:57.380148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:57.386130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 690/1407] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:03:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:03:57.388410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c52ac-5b63-40fe-be33-dfddb4f83f38 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:57.389378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c52ac-5b63-40fe-be33-dfddb4f83f38 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:57.389667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c52ac-5b63-40fe-be33-dfddb4f83f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:57.473019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-db1c52ac-5b63-40fe-be33-dfddb4f83f38 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:03:57.474267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db1c52ac-5b63-40fe-be33-dfddb4f83f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:57.605206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 718/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:03:57.653426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:03:57.655026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:57.827595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:57.829876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653589a7-db4d-4f6c-ab71-80566ded7d31 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:03:58.044813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:03:58.045784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:03:58.046199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:03:58.047374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:03:58.049485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:03:58.165524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:03:58.167322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b775d-a71b-4e6d-8b98-3f9b14d9f6fb service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:03:58.191932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 691/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:07.603503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=76 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:08.189242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:14.124366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3b93-71b4-4391-abdf-ff9dfbd4c4e0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:14.125599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3b93-71b4-4391-abdf-ff9dfbd4c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:14.125599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3b93-71b4-4391-abdf-ff9dfbd4c4e0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:14.126937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 719/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 3 12:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:14.132402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5129-9b44-453a-8495-8893b959a5b1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:14.132920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5129-9b44-453a-8495-8893b959a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:14.133039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5129-9b44-453a-8495-8893b959a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:14.225163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a9cd5129-9b44-453a-8495-8893b959a5b1 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:14.226495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a9cd5129-9b44-453a-8495-8893b959a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:14.354573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 692/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 3 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:14.370960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fe02-e9bb-4720-922a-fcfb024a471f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:14.371254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fe02-e9bb-4720-922a-fcfb024a471f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:14.371565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fe02-e9bb-4720-922a-fcfb024a471f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:14.372933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 720/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 3 12:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:14.378923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36892c1-e66e-49b3-ac5e-9ec06062df65 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:14.379146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36892c1-e66e-49b3-ac5e-9ec06062df65 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:14.379519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36892c1-e66e-49b3-ac5e-9ec06062df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:14.468794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:14.473813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f36892c1-e66e-49b3-ac5e-9ec06062df65 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:14.475858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f36892c1-e66e-49b3-ac5e-9ec06062df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:14.628223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 693/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 3 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:17.182801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:17.183411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:17.183699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:17.185692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:17.191942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97d8b-e12e-468f-adbd-d661ab17f504 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:17.192504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97d8b-e12e-468f-adbd-d661ab17f504 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:17.192504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d97d8b-e12e-468f-adbd-d661ab17f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:17.267268 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-48d97d8b-e12e-468f-adbd-d661ab17f504 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:17.268479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-48d97d8b-e12e-468f-adbd-d661ab17f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:17.324775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:17.368553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:17.413319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:17.415011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:17.563761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288adb5-6d18-4cea-a489-3abe00f2b1b8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:17.638074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:17.682735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:17.683361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:17.683641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:17.683912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:17.685535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:17.775228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:17.776852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4deb9c-0c0e-43de-8ea2-1ac182094d78 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:17.796228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 722/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:18.704880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:18.705471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:18.705471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:18.706854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:18.712017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1404a-d483-4bce-82ff-a2b0520c3609 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:18.712497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1404a-d483-4bce-82ff-a2b0520c3609 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:18.713312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1404a-d483-4bce-82ff-a2b0520c3609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:18.797719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b9e1404a-d483-4bce-82ff-a2b0520c3609 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:18.798991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b9e1404a-d483-4bce-82ff-a2b0520c3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:18.827089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:18.898239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:19.052054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:19.053687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:19.214263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122af5e-d9ac-4c07-b801-b2577991e8b0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:19.257018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:19.334950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:19.335476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:19.335766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:19.336041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:19.337692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:19.431206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:19.432825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484467e-63c1-4dc2-961b-fe148ffeb5ae service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:19.451401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 696/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:20.345713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:20.346278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:20.346278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:20.347794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:20.353198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475906e2-a498-435d-a794-92c1197d91b0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:20.353679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475906e2-a498-435d-a794-92c1197d91b0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:20.353920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475906e2-a498-435d-a794-92c1197d91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:20.412858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:20.436563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-475906e2-a498-435d-a794-92c1197d91b0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:20.437833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-475906e2-a498-435d-a794-92c1197d91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:20.540943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:20.694667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:20.696185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:20.841730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca1f7-73ee-45c6-9be0-f5525f082822 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:20.854310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:20.956195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:20.956812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:20.957088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:20.957358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:20.958994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:21.048219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:21.049828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7a55-40b5-4efb-8a8f-3ad536841ef7 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:21.068384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 725/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:21.942930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:21.943502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:21.943502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:21.944833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:21.950041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34aa13-d77e-41ed-a18a-a350bda3320f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:21.950479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34aa13-d77e-41ed-a18a-a350bda3320f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:21.950643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34aa13-d77e-41ed-a18a-a350bda3320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:21.970601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:22.028852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cf34aa13-d77e-41ed-a18a-a350bda3320f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:22.030073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cf34aa13-d77e-41ed-a18a-a350bda3320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:22.126748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:22.278423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:22.279978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:22.390612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:22.426681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc2540-4d2d-4a48-8c15-1eeae81f941c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:22.541217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:22.541847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:22.542136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:22.542415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:22.544073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:22.619713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:22.635054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:22.636685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dedde-67d8-42ab-b7ba-9895d8077b73 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:22.655482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 699/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:23.531446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:23.532086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:23.532086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:23.533416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:23.538505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293b25-c666-45a0-bc74-746e682c918b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:23.538965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293b25-c666-45a0-bc74-746e682c918b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:23.539067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293b25-c666-45a0-bc74-746e682c918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:23.616936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0a293b25-c666-45a0-bc74-746e682c918b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:23.618172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0a293b25-c666-45a0-bc74-746e682c918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:23.717150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:23.877622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:23.879201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:23.964301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:24.027522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6007-70f4-4d8e-a6b1-447bab58ca3f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:24.274593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:24.275226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:24.275511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:24.275791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:24.277416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:24.325592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:24.369039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:24.370668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed177bd-60df-4d3c-95be-a1ec7a6f8dfe service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:24.389695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 728/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:25.218997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:25.219614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:25.219614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:25.220945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:25.226173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc7c7-e045-4382-9afe-4d4501356a58 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:25.226641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc7c7-e045-4382-9afe-4d4501356a58 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:25.226770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc7c7-e045-4382-9afe-4d4501356a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:25.302222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2aabc7c7-e045-4382-9afe-4d4501356a58 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:25.303458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2aabc7c7-e045-4382-9afe-4d4501356a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:25.399481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:25.549262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:25.550952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:25.600507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:25.699065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9cfe-92b7-43bc-a339-3cdb0226e9a6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:25.815045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:25.815668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:25.815952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:25.816239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:25.817895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:25.825391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:25.910098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:25.911769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cd522-4d81-475c-9217-64958fdb7620 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:25.930436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 702/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:26.727360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:26.727927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:26.727927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:26.729300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:26.734367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeba5a-1242-43ab-b82d-c9a98708bd69 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:26.734840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeba5a-1242-43ab-b82d-c9a98708bd69 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:26.734941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeba5a-1242-43ab-b82d-c9a98708bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:26.815308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b0eeba5a-1242-43ab-b82d-c9a98708bd69 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:26.816530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b0eeba5a-1242-43ab-b82d-c9a98708bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:26.884555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:26.916039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:27.066992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:27.068505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:27.087070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:27.217675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351c70b-0a05-43a1-806f-30a903972806 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:27.313706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:27.340541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:27.341080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:27.341359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:27.341630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:27.343262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:27.433192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:27.434836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102db104-5a1e-48b6-9aa8-afca665c7af2 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:27.453387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 731/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:28.258489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:28.259040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:28.259040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:28.260459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:28.266151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd3d7-79f9-45d6-b329-99d4539c8a5d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:28.266604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd3d7-79f9-45d6-b329-99d4539c8a5d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:28.266752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd3d7-79f9-45d6-b329-99d4539c8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:28.352819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-81ffd3d7-79f9-45d6-b329-99d4539c8a5d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:28.353957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-81ffd3d7-79f9-45d6-b329-99d4539c8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:28.397886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:28.453404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:28.607272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:28.608734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:28.753740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f12e0-7c04-483a-83ba-06f30b9107fe None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:28.807379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:28.865708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:28.866233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:28.866541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:28.866820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:28.868439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:28.957947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:28.959562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19104f-aa78-44fd-a4a7-4d9827cb94f1 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:28.977344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 705/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:29.784778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:29.785353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:29.785462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:29.787128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:29.792615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906ab3-df0e-4de1-89b9-91c10051d2b2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:29.793367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906ab3-df0e-4de1-89b9-91c10051d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:29.793367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906ab3-df0e-4de1-89b9-91c10051d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:29.873621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d1906ab3-df0e-4de1-89b9-91c10051d2b2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:29.874945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d1906ab3-df0e-4de1-89b9-91c10051d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:29.877106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:29.974855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:30.124993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:30.126745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:30.279244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7753446-aa69-41bb-8b59-a73cf57096e1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:30.305277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:30.397882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:30.398420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:30.398732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:30.399011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:30.401790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:30.500045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:30.502655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9189-80be-4b60-abdd-f79843a2c8e1 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:30.521998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 734/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:32.454432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:32.455030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:32.455030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:32.456430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:32.461685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da20f4-c4fd-4c46-b023-f7f18530407b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:32.462189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da20f4-c4fd-4c46-b023-f7f18530407b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:32.462294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da20f4-c4fd-4c46-b023-f7f18530407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:32.506042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:32.534387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e9da20f4-c4fd-4c46-b023-f7f18530407b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:32.535647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e9da20f4-c4fd-4c46-b023-f7f18530407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:32.634422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:32.673981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:32.675581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:32.781741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2112-e4d0-4aba-aa62-674042e74d80 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:32.814757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:32.855563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:32.856185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:32.856471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:32.856749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:32.858391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:32.968644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:32.970081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132e563-a437-45c9-b4dd-4497354a2d84 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:32.989966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 708/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:35.225621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:35.226189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:35.226189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:35.227540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:35.233520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4102f1-4980-4a1e-86bf-980fbc147542 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:35.234090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4102f1-4980-4a1e-86bf-980fbc147542 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:35.234090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4102f1-4980-4a1e-86bf-980fbc147542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:35.308751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ef4102f1-4980-4a1e-86bf-980fbc147542 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:35.309991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ef4102f1-4980-4a1e-86bf-980fbc147542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:35.324597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:35.417601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:35.456560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:35.458089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:35.565618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899be0d-317d-4614-9a50-f35b0b86dd5d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:35.578628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:35.649741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:35.650357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:35.650671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:35.650952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:35.652569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:35.770185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:35.771643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62df4-684d-40fd-ac25-b75e517bb794 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:35.789598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 737/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:38.151622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:38.152172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:38.152172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:38.153526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:38.159439 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e593e-b600-4b22-b973-09f80a7e6ca9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:38.159881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e593e-b600-4b22-b973-09f80a7e6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:38.159991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e593e-b600-4b22-b973-09f80a7e6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:38.208324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:38.227829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-216e593e-b600-4b22-b973-09f80a7e6ca9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:38.229047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-216e593e-b600-4b22-b973-09f80a7e6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:38.326812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:38.365399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:38.366986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:38.475837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01f411-2c8f-4577-80fe-7bff6c453c3d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:38.516910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:38.550128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:38.550788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:38.551079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:38.551359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:38.553223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:38.663016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:38.664468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a1f8-635f-49e1-a9e7-77fd33ef9c4b service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:38.682945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 711/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:40.812021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:40.812593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:40.812714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:40.813992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:40.819473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ff8a-b104-47a6-b65f-7507e69b67f7 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:40.819886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ff8a-b104-47a6-b65f-7507e69b67f7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:40.820039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ff8a-b104-47a6-b65f-7507e69b67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:40.894249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6ec1ff8a-b104-47a6-b65f-7507e69b67f7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:40.895518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6ec1ff8a-b104-47a6-b65f-7507e69b67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:40.916193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:41.000066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:41.042977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:41.044523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:41.160416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb94d8-0574-4eb6-8fd5-8de3448866b5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:41.183543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:41.241094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:41.241724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:41.242009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:41.242284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:41.244037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:41.372136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:41.373566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de841-42b6-4f0a-9146-564d5ccedf5b service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:41.395233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 740/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:43.580581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:43.581118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:43.581118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:43.582559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:43.587938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53bb7c-a614-420a-8e79-1b74d3eed852 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:43.588444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53bb7c-a614-420a-8e79-1b74d3eed852 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:43.588563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53bb7c-a614-420a-8e79-1b74d3eed852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:43.663225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:43.666065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3a53bb7c-a614-420a-8e79-1b74d3eed852 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:43.667995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3a53bb7c-a614-420a-8e79-1b74d3eed852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:43.763123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:43.801745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:43.803333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:43.909989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9d208-4c04-4133-9e1d-74732add4369 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:43.962456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:43.987739 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:43.988359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:43.988643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:43.988921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:43.990573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:44.105722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:44.107124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c53617-12b4-4e3e-86b1-b5329eacece1 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:44.125206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 714/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:46.242814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:46.243199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:46.243410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:46.244662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:46.250086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac97c-44ce-4e73-8bce-8dbae09e7d38 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:46.250607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac97c-44ce-4e73-8bce-8dbae09e7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:46.250702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac97c-44ce-4e73-8bce-8dbae09e7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:46.317882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2adac97c-44ce-4e73-8bce-8dbae09e7d38 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:46.319136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2adac97c-44ce-4e73-8bce-8dbae09e7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:46.349264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:46.421454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:46.459484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:46.461003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:46.566615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0edcb-7fe9-445e-b113-c913c805d9e5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:46.595810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:46.642026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:46.642698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:46.643015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:46.643292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:46.644943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:46.755837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:46.757281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440fda-7cb7-4f08-9f12-7fe78bb61e96 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:46.776503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 743/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:48.872060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:48.872618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:48.872618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:48.874530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:48.879941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bdd-33d8-4585-b477-4c5066d7d2bd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:48.880396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bdd-33d8-4585-b477-4c5066d7d2bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:48.880505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bdd-33d8-4585-b477-4c5066d7d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:48.947007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0fd64bdd-33d8-4585-b477-4c5066d7d2bd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:48.948203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0fd64bdd-33d8-4585-b477-4c5066d7d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:48.957179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:49.046967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:49.086175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:49.087808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:49.199943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f158cd-d5c4-4591-960e-8c602b4da289 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:49.258069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:49.277398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:49.278024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:49.278308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:49.278623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:49.280276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:49.525268 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:49.526762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a1e86-10f3-44b6-9e5f-866747a04eea service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:49.545433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 717/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:51.643435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:51.643995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:51.643995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:51.645353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:51.650753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f9c6f-8c0d-4bd9-8199-a362ea550bea None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:51.651298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f9c6f-8c0d-4bd9-8199-a362ea550bea None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:51.651298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f9c6f-8c0d-4bd9-8199-a362ea550bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:51.718341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6d7f9c6f-8c0d-4bd9-8199-a362ea550bea None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:51.719624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6d7f9c6f-8c0d-4bd9-8199-a362ea550bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:51.758875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:51.819900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:51.857291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:51.858883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:51.963171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a33be0-ad79-4466-894a-29c582a38ed7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:52.000378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:52.036551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:52.037113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:52.037392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:52.037666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:52.039322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:52.153143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:52.154631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371527fa-e846-43b0-871e-22e648f316d9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:52.172973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 746/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:54.210117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:54.210713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:54.210713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:54.212066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:54.217998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b097c-994b-4f2d-bf4f-07cb825a3a0e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:54.218493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b097c-994b-4f2d-bf4f-07cb825a3a0e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:54.218607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b097c-994b-4f2d-bf4f-07cb825a3a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:54.289791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-243b097c-994b-4f2d-bf4f-07cb825a3a0e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:54.291028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-243b097c-994b-4f2d-bf4f-07cb825a3a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:54.310067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:54.391560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:04:54.428685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:54.430255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:54.541712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4866d-e9ea-45b9-8b41-1a1a331e1657 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:54.612667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:54.620219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:54.620879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:54.621166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:54.621444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:54.623133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:54.736007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:54.737359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c3be9-5d8c-4a15-adfc-c533f8644e7e service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:54.756227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 720/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:56.817783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:56.818342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:56.818342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:56.819753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:04:56.825062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8773-827b-4945-a697-722df1f46e6c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:56.825518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8773-827b-4945-a697-722df1f46e6c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:56.825660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8773-827b-4945-a697-722df1f46e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:56.893356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d7ef8773-827b-4945-a697-722df1f46e6c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:04:56.894600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d7ef8773-827b-4945-a697-722df1f46e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:56.942417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:56.992229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:04:57.029840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:04:57.031924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:57.136545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9f8c3-414a-4af7-8def-bc1d36b06ba8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:04:57.183888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:57.210648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:04:57.211270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:04:57.211548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:04:57.211817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:04:57.213427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:04:57.322247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:04:57.323735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf32c7-90fd-425c-b69b-e157e2800ba9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:04:57.342049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 749/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:06.990323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=22 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:07.339800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=66 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:17.095656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d908-9fd0-4350-8cc6-2ff04702a6ed None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:17.096343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d908-9fd0-4350-8cc6-2ff04702a6ed None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:17.096343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50d908-9fd0-4350-8cc6-2ff04702a6ed None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:17.097606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 722/1471] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:17.103108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818522-4ff3-4b5d-8c87-807cc9b0316c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:17.103541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818522-4ff3-4b5d-8c87-807cc9b0316c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:17.103674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818522-4ff3-4b5d-8c87-807cc9b0316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:17.170975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5d818522-4ff3-4b5d-8c87-807cc9b0316c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:17.172208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5d818522-4ff3-4b5d-8c87-807cc9b0316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:17.277245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 750/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:17.363912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:17.364202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:17.364514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:17.365879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 723/1473] 10.222.0.17 () {54 vars in 966 bytes} [Wed Aug 3 12:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:17.370847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c11ca-4833-463f-a4ff-2e54709ac238 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:17.371132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c11ca-4833-463f-a4ff-2e54709ac238 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:17.371414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c11ca-4833-463f-a4ff-2e54709ac238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:17.450610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e63c11ca-4833-463f-a4ff-2e54709ac238 None None] MFA Rules not processed for user `07fbf4cc412649fba94ad020f6221b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:17.452477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e63c11ca-4833-463f-a4ff-2e54709ac238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:17.474391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:17.536937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 751/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Wed Aug 3 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:05:17.544586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:17.546184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:17.652909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599710-de49-4a40-ad69-3f04ab9d58ff None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:17.728913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:17.729539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:17.729824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:17.730102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:17.731761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:17.786764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:17.843090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:17.844529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16184427-cd71-4dc8-8bb4-64ec86efe555 service glance] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:17.863754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 724/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:19.944279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:19.944874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:19.944874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:19.946195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 752/1476] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:19.952481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053a5-2b45-4ac3-b4be-a0e0f14d83cf None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:19.952989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053a5-2b45-4ac3-b4be-a0e0f14d83cf None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:19.953091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053a5-2b45-4ac3-b4be-a0e0f14d83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:20.021423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-90a053a5-2b45-4ac3-b4be-a0e0f14d83cf None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:20.022713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-90a053a5-2b45-4ac3-b4be-a0e0f14d83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:20.120457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 725/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:20.144779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:20.146490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:20.271514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71711d4f-0539-4958-bed4-c6c6e4e9859f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:20.321325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:20.367951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:20.369233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:20.369848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:20.370393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:20.371975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:20.375798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:05:20.375798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:05:20.375798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:05:20.378098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b9e0-7e23-4af8-8ede-137bafac2294 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:20.400115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 753/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 3 12:05:20 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:05:22.457298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:22.457835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:22.457835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:22.459318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 726/1479] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:22.464781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a48c-6250-4103-ad80-7f29171e482d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:22.465295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a48c-6250-4103-ad80-7f29171e482d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:22.465399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a48c-6250-4103-ad80-7f29171e482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:22.542962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-51e5a48c-6250-4103-ad80-7f29171e482d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:22.544099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-51e5a48c-6250-4103-ad80-7f29171e482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:22.643907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 754/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:05:22.687792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:22.689417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:22.699669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:22.837423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d4db-96c2-41fb-b7b6-19ee187828ea None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:22.918753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:22.951939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:22.952552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:22.952831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:22.953102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:22.954738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:23.044905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:23.046547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f042-e20a-497c-8ee5-14cc606ef84a service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:23.064298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 727/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:25.296134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:25.296818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:25.296818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:25.298060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 755/1482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:25.303998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d996e-bd88-44da-a3c8-99c5b4f1b37e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:25.304516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d996e-bd88-44da-a3c8-99c5b4f1b37e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:25.304676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d996e-bd88-44da-a3c8-99c5b4f1b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:25.372369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-971d996e-bd88-44da-a3c8-99c5b4f1b37e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:25.374227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-971d996e-bd88-44da-a3c8-99c5b4f1b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:25.423473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:25.474091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 728/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:25.513060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:25.515933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:25.539283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:25.627929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b939b8-437f-4306-a560-3661ee0b50eb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:25.701681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:25.702297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:25.702606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:25.702881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:25.704496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:25.781110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:25.823506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:25.824944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eae14-ff62-47ff-995f-6f6eb703239c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:25.844184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 756/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:27.924774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:27.925318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:27.925318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:27.926819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 729/1485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:27.932087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99329e1-01a1-4999-a6ad-7622db77d308 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:27.932543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99329e1-01a1-4999-a6ad-7622db77d308 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:27.932697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99329e1-01a1-4999-a6ad-7622db77d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:27.999384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d99329e1-01a1-4999-a6ad-7622db77d308 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:28.000608 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d99329e1-01a1-4999-a6ad-7622db77d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:28.104873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 757/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:28.144215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:28.145774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:28.258055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e592f-8338-4873-8526-e9c0351847a0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:28.330457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:28.332282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:28.332893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:28.333397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:28.333721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:28.335797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:28.445742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:28.447134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c245d-4852-433a-b256-ed296daaa772 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:28.471210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 730/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:30.634137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:30.634745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:30.634745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:30.636055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 758/1488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:30.642285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6dc79-7507-4cdd-bc18-a91278a72d91 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:30.642919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6dc79-7507-4cdd-bc18-a91278a72d91 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:30.642919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6dc79-7507-4cdd-bc18-a91278a72d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:30.714391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-51e6dc79-7507-4cdd-bc18-a91278a72d91 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:30.715698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-51e6dc79-7507-4cdd-bc18-a91278a72d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:30.768716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:30.813579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 731/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:30.853264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:30.854816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:30.892333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:30.961681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aff69-c906-4f03-9f58-85cb47aab3c4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:31.034948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:31.035576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:31.035860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:31.036138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:31.037768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:31.118696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:31.148619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:31.149994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939beaf-b2c5-458c-97bc-5cbb463fd264 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:31.168835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 759/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:33.421072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:33.421660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:33.421660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:33.423082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 732/1491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Aug 3 12:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:05:33.428511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c65d-0ac8-4a64-8032-d6a885eb1624 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:33.428941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c65d-0ac8-4a64-8032-d6a885eb1624 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:33.429054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c65d-0ac8-4a64-8032-d6a885eb1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:33.500322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fb66c65d-0ac8-4a64-8032-d6a885eb1624 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:05:33.501545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fb66c65d-0ac8-4a64-8032-d6a885eb1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:33.597035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 760/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Aug 3 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:05:33.636464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:05:33.638008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:33.747548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516deb1-92f7-4262-8f8d-4b626ebff82c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:05:33.821890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:05:33.822534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:05:33.822819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:05:33.823094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:05:33.824714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:05:33.834099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:33.944090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:05:33.945535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac62cf9-3111-4254-9312-c137982caf6a service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:05:33.963138 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 733/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:05:43.595217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=82 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:43.960867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=50 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:02.102628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:02.103264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:02.103264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:02.178430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:07:02.179672 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:02.278538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 761/1494] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:07:02.286731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:02.287260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:02.287370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:02.363329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:07:02.364467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:02.461203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 734/1495] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:07:02.466024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:02.467266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:02.478585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb38e7d-82ea-4949-8ed1-d6f533c4a254 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:02.544339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:02.578984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:02.579606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:02.579884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:02.580156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:02.580845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:07:02.581145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:02.582167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:02.582167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:07:02.582167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:07:02.583072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:02.593960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 762/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:07:02.602415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:02.611996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b05e-7332-4cb3-aaf7-39e7b3970625 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:02.675282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:02.709993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:02.710646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:02.710936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:02.711218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:02.711892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:02.713691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:02.713691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:07:02.713691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:07:02.714967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:02.770609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 735/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:07:02 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:07:02.774963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:02.776500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:02.809837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296a1a-5f16-4ab8-b80e-db256b99e44b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:02.901596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:02.902212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:02.902516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:02.902818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:02.903481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:02.904487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:02.904487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:07:02.904487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:07:02.905681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:02.947370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 763/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:07:02 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:07:02.951403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:02.952925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.014086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0860-03a7-4c1e-84be-4bdda60ddb84 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:03.097519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:03.109953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:03.110616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.110926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.111186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.111879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:03.112906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:03.112906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:07:03.112906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:07:03.113800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:03.126247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 736/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:07:03.130395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:03.131965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.143701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644f430-c074-4956-a6e9-7d5956c46d33 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:03.169699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:03.244555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:03.245097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.245384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.245665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.246380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:03.247414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:03.247414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:07:03.247414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:07:03.248302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849e80-84f1-4721-a3db-56b13897e6f8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:03.260602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 764/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:07:03.264909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:03.266722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.302562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe3-967f-4957-b341-65ba27895747 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:03.397580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:03.398257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.398582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.398864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] PATH_INFO: `/v3/projects/e129f1dbf6f945f2bbe7dad7e7394d6f/users/ae866db90cf0432e910d5ca9cfdc7107/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.421211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129f1dbf6f945f2bbe7dad7e7394d6f, user_id=ae866db90cf0432e910d5ca9cfdc7107, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:03.422255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:03.422255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:07:03.422255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:07:03.424243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ffcd1-b389-46d2-bb62-1b1b71a4378f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:03.448087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 737/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:07:03 2022] PUT /identity/v3/projects/e129f1dbf6f945f2bbe7dad7e7394d6f/users/ae866db90cf0432e910d5ca9cfdc7107/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:07:03.460746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce9451-85d0-4832-a921-9562c6eb2891 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.461039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce9451-85d0-4832-a921-9562c6eb2891 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.461427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce9451-85d0-4832-a921-9562c6eb2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.519702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b1ce9451-85d0-4832-a921-9562c6eb2891 None None] MFA Rules not processed for user `ae866db90cf0432e910d5ca9cfdc7107`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:07:03.521132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b1ce9451-85d0-4832-a921-9562c6eb2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.601271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 765/1502] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:07:03.614628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.614921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.615200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.616583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 738/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 3 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:07:03.621322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049133fd-6ce1-4f02-97ec-258038b59c48 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.621606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049133fd-6ce1-4f02-97ec-258038b59c48 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.621878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049133fd-6ce1-4f02-97ec-258038b59c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.653590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:03.696277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-049133fd-6ce1-4f02-97ec-258038b59c48 None None] MFA Rules not processed for user `acea16a4c33b4d5e96889f5600c35666`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:07:03.697463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-049133fd-6ce1-4f02-97ec-258038b59c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.775502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 766/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 3 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:07:03.783669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:03.785184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:03.838905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:03.894287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1510-58b9-43a0-8333-f2c083902bd9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:03.967416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:03.968039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:03.968325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:03.968607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:03.970227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:04.068216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:04.069580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:04.073101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:04.088093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 739/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:07:04.134858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c2-4287-49b1-9db3-90d866bf1238 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:04.135268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c2-4287-49b1-9db3-90d866bf1238 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:04.135443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c2-4287-49b1-9db3-90d866bf1238 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:04.136753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 767/1506] 10.222.0.17 () {52 vars in 830 bytes} [Wed Aug 3 12:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:07:04.141308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:04.142626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:04.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a7283-8a8d-45d1-adee-872e7e22d598 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:04.336213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:04.336798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:04.337073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:04.337355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] PATH_INFO: `/v3/users/ae866db90cf0432e910d5ca9cfdc7107` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:04.350100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae866db90cf0432e910d5ca9cfdc7107)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:04.351186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:04.351186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:07:04.351186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:07:04.352437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:04.362064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:04.419735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae866db90cf0432e910d5ca9cfdc7107'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:04.433896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae866db90cf0432e910d5ca9cfdc7107'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:04.456761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae866db90cf0432e910d5ca9cfdc7107'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:04.466918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae866db90cf0432e910d5ca9cfdc7107'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:04.467355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae866db90cf0432e910d5ca9cfdc7107'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:04.473638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 740/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:07:04 2022] DELETE /identity/v3/users/ae866db90cf0432e910d5ca9cfdc7107 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:07:04.481458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:04.482195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:04.482195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:04.540586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:07:04.541802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:04.617578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:04.632515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 768/1508] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:07:04.643471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:04.644719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:04.742567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79bc1-1892-4bb0-bd9f-b92cd124a51a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:04.797294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:04.818308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:04.818961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:04.819244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:04.819520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:04.821135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:04.928608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:04.929971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1e28b-74ea-4f6e-ad92-8b3e903cd6d9 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:04.950609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 741/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:07:05.327112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:07:05.328422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:07:05.339936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe42bb-d8bb-48b4-8939-8c8030ba920f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:07:05.440766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:07:05.441414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:07:05.441692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:07:05.441966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] PATH_INFO: `/v3/projects/e129f1dbf6f945f2bbe7dad7e7394d6f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:07:05.451852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129f1dbf6f945f2bbe7dad7e7394d6f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:07:05.452823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:07:05.452823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:07:05.452823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:07:05.454015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:07:05.519472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129f1dbf6f945f2bbe7dad7e7394d6f', 'request_id': 'req-762337ac-00dd-4bf4-ab72-3684c254657a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:05.525612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129f1dbf6f945f2bbe7dad7e7394d6f', 'request_id': 'req-762337ac-00dd-4bf4-ab72-3684c254657a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:05.539103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129f1dbf6f945f2bbe7dad7e7394d6f', 'request_id': 'req-762337ac-00dd-4bf4-ab72-3684c254657a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:05.565890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] The token cache is being invalidate because project e129f1dbf6f945f2bbe7dad7e7394d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:07:05.566185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:05.566754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-762337ac-00dd-4bf4-ab72-3684c254657a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:07:05.568121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 769/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:07:05 2022] DELETE /identity/v3/projects/e129f1dbf6f945f2bbe7dad7e7394d6f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:07:14.948228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=62 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:07:15.563797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:08:47.007680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:47.008324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:47.008324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:47.009606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:08:47.015115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efab57-629b-45f0-aa64-74f8b6de2fc4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:47.015613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efab57-629b-45f0-aa64-74f8b6de2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:47.015763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efab57-629b-45f0-aa64-74f8b6de2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:47.097794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e9efab57-629b-45f0-aa64-74f8b6de2fc4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:08:47.099126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e9efab57-629b-45f0-aa64-74f8b6de2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:47.232473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:08:47.388499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:08:47.391286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:47.520528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff94b-f30d-48ac-8c61-cc1be8fd3860 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:08:47.526983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:08:47.527611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:47.527894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:47.528175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:47.537405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:08:47.539085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b44ef-19c5-4477-8cfc-502a59b78627 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:08:47.549595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 743/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:08:48.417304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005706-7092-4604-9bed-28272252cdbb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:48.417941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005706-7092-4604-9bed-28272252cdbb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:48.417941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005706-7092-4604-9bed-28272252cdbb None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:48.419199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:08:48.425464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e08-6794-4ce8-9c72-1a3272b5d905 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:48.426234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e08-6794-4ce8-9c72-1a3272b5d905 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:48.426234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986e08-6794-4ce8-9c72-1a3272b5d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:48.446020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4b986e08-6794-4ce8-9c72-1a3272b5d905 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:08:48.447262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b986e08-6794-4ce8-9c72-1a3272b5d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:48.455239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:08:48.462593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f3d-b8bc-4dd9-ac54-a2868d9b9b7f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:48.462964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f3d-b8bc-4dd9-ac54-a2868d9b9b7f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:48.463433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f3d-b8bc-4dd9-ac54-a2868d9b9b7f None None] PATH_INFO: `/v3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:48.465760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 772/1516] 10.222.0.49 () {54 vars in 925 bytes} [Wed Aug 3 12:08:48 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:08:48.472512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7d1b-7de7-47f0-87a1-bdf3b22be2ae None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:48.472873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7d1b-7de7-47f0-87a1-bdf3b22be2ae None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:48.473449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7d1b-7de7-47f0-87a1-bdf3b22be2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:48.555460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-758f7d1b-7de7-47f0-87a1-bdf3b22be2ae None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:08:48.557510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-758f7d1b-7de7-47f0-87a1-bdf3b22be2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:48.613499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec088f3d-b8bc-4dd9-ac54-a2868d9b9b7f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:08:48.628513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec088f3d-b8bc-4dd9-ac54-a2868d9b9b7f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:08:48.633964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:08:48.634694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:48.634985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:48.635266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:48.644465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:08:48.646092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75270d0-9ce5-49b7-8857-88c8f70a6c27 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:08:48.651583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:08:48.657614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 773/1517] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:08:48.678337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 745/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 3 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:08:52.520617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1ec5-9736-4a62-bbe5-af545c2be420 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:52.521165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1ec5-9736-4a62-bbe5-af545c2be420 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:52.521165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1ec5-9736-4a62-bbe5-af545c2be420 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:52.522466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 774/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 3 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:08:52.527491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089dd6-fe92-4d6e-ade3-7aa7422930e1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:52.527893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089dd6-fe92-4d6e-ade3-7aa7422930e1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:52.528055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089dd6-fe92-4d6e-ade3-7aa7422930e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:52.547154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7a089dd6-fe92-4d6e-ade3-7aa7422930e1 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:08:52.548334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7a089dd6-fe92-4d6e-ade3-7aa7422930e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:52.557063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 746/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 3 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:08:52.564883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1ec5-9736-4a62-bbe5-af545c2be420 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:08:52.578536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1ec5-9736-4a62-bbe5-af545c2be420 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:08:52.583425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:08:52.584030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:52.584320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:52.584602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:52.592839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:08:52.594424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703309a5-5832-4ad7-ab02-2f1b01f544f8 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:08:52.603953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 775/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:08:59.896347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c708c5-8b87-4f26-ab8b-3bd7e37e4d8f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:59.896904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c708c5-8b87-4f26-ab8b-3bd7e37e4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:59.896904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c708c5-8b87-4f26-ab8b-3bd7e37e4d8f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:59.898374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:08:59.903227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e7cf2-57df-4215-aeb3-cfb5f56fbc8f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:08:59.903683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e7cf2-57df-4215-aeb3-cfb5f56fbc8f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:08:59.903939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e7cf2-57df-4215-aeb3-cfb5f56fbc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:08:59.924122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1e1e7cf2-57df-4215-aeb3-cfb5f56fbc8f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:08:59.925320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1e1e7cf2-57df-4215-aeb3-cfb5f56fbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:08:59.937110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:00.090033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c708c5-8b87-4f26-ab8b-3bd7e37e4d8f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:00.104769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c708c5-8b87-4f26-ab8b-3bd7e37e4d8f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:00.110318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:00.110986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:00.111274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:00.111557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:00.119970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:00.121576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35757-32fd-43ba-a562-61ca6952965b service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:00.131879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 748/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:09:00.962554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c85e-01e0-4ce7-9c35-2fd4099d7d29 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:00.963141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c85e-01e0-4ce7-9c35-2fd4099d7d29 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:00.963141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c85e-01e0-4ce7-9c35-2fd4099d7d29 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:00.964555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:09:00.969873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e978-149f-426a-947c-f008a0f081e0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:00.970314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e978-149f-426a-947c-f008a0f081e0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:00.970414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e978-149f-426a-947c-f008a0f081e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:00.990168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c503e978-149f-426a-947c-f008a0f081e0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:09:00.991397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c503e978-149f-426a-947c-f008a0f081e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:00.999282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:01.152292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578c85e-01e0-4ce7-9c35-2fd4099d7d29 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:01.167879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578c85e-01e0-4ce7-9c35-2fd4099d7d29 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:01.173599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:01.174219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:01.174539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:01.174826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:01.183283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:01.184871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85f50-d96b-47a0-9c8d-44eee33f99b8 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:01.195040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 778/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:09:05.022283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:05.023027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:05.023027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:05.024363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:09:05.030701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e214-818d-46f1-9d30-759f4b07b1e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:05.031217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e214-818d-46f1-9d30-759f4b07b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:05.031346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e214-818d-46f1-9d30-759f4b07b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:05.054149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-20c2e214-818d-46f1-9d30-759f4b07b1e8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:09:05.055389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-20c2e214-818d-46f1-9d30-759f4b07b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:05.063388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:05.142171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:05.143928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:05.226830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe5d9-a85f-4cf7-8da3-514c855ee4aa None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:05.230492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:05.231126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:05.231418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:05.231702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:05.242043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:05.243591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fd8ce-22af-4db4-90b2-3767af5f6114 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:05.253228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 751/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:09:07.239716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be80a-2a25-435c-94e5-79c13bdf469e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:07.240322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be80a-2a25-435c-94e5-79c13bdf469e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:07.240617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be80a-2a25-435c-94e5-79c13bdf469e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:07.243388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:09:07.248796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7b57-84c1-41f0-8309-4908f80fac04 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:07.249230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7b57-84c1-41f0-8309-4908f80fac04 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:07.249360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7b57-84c1-41f0-8309-4908f80fac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:07.269544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e99f7b57-84c1-41f0-8309-4908f80fac04 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:09:07.270774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e99f7b57-84c1-41f0-8309-4908f80fac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:07.278667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:07.316194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be80a-2a25-435c-94e5-79c13bdf469e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:07.326899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be80a-2a25-435c-94e5-79c13bdf469e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:07.330410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:07.331045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:07.331327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:07.331604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:07.340399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:07.341825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c381afe-3e95-476d-b1b6-e95f65e25a22 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:07.351091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 781/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:09:11.050732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:11.051309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:11.051309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:11.052672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:09:11.057864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d832-9993-4c0c-82fc-b28a9f501e17 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:11.058275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d832-9993-4c0c-82fc-b28a9f501e17 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:11.058420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d832-9993-4c0c-82fc-b28a9f501e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:11.066145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:09:11.079206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9a56d832-9993-4c0c-82fc-b28a9f501e17 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:09:11.080415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9a56d832-9993-4c0c-82fc-b28a9f501e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:11.088242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:11.394836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:11.396514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:11.488967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ab3a1-5ee1-4c83-8bcb-68d21c163a4b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:11.492711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:11.493334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:11.493628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:11.493910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:11.503755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:11.505212 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f113d-d1aa-474a-b7f2-4f57a6fa0d3d service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:11.515308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 754/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:09:13.555366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:13.555926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:13.555926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:13.557324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:09:13.562847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f06b-d6f4-486b-a717-c7d8ee7cd6f0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:13.563290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f06b-d6f4-486b-a717-c7d8ee7cd6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:13.563417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f06b-d6f4-486b-a717-c7d8ee7cd6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:13.583764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2ee3f06b-d6f4-486b-a717-c7d8ee7cd6f0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:09:13.584983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2ee3f06b-d6f4-486b-a717-c7d8ee7cd6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:13.593947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:09:13.897040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:09:13.898859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:09:13.912459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4536-6fbb-4e15-b588-fe1a8a383f90 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:09:13.915968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:09:13.916573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:09:13.916854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:09:13.917129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:09:13.926008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:09:13.927493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4b222-dd60-482e-9855-f4c083a0ee44 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:09:13.937610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 784/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:09:23.578741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:09:23.933117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:49.769303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:49.769960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:49.769960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:49.796134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:49.797378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:49.811558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 756/1540] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:10:49.821002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c7b9-5233-400d-b405-41029106aabd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:49.821628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c7b9-5233-400d-b405-41029106aabd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:49.821628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959c7b9-5233-400d-b405-41029106aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:49.856421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8959c7b9-5233-400d-b405-41029106aabd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:49.857660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8959c7b9-5233-400d-b405-41029106aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:49.869779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 785/1541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:49.874850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:49.889717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d46e6-9259-4498-8ba0-b63944fd3e29 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:49.897336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:49.898001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:49.898294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:49.898611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:49.899380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:49.899698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:49.900790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:10:49.900790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:10:49.900790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:10:49.901716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:49.919673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 757/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:49.930294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c7b9-5233-400d-b405-41029106aabd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:49.940953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959c7b9-5233-400d-b405-41029106aabd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:49.952842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:49.953639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:49.953932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:49.954220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:49.954997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:49.956084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:10:49.956084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:10:49.956084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:10:49.957367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b0051-3842-40ec-a48c-ea3444a6a2fa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.012399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 786/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:49 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:50.018279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.037318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b55d4-acfc-4b0d-9572-64f30b774130 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.183556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.185793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.186701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.187555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.189497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.192033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:10:50.192033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:10:50.192033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:10:50.194433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.197505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34a64e-6415-41ab-b2ae-bee9b5c9d494 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.197813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34a64e-6415-41ab-b2ae-bee9b5c9d494 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.198135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34a64e-6415-41ab-b2ae-bee9b5c9d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.250793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 758/1544] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:10:50.255437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.271226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-aa34a64e-6415-41ab-b2ae-bee9b5c9d494 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.272497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aa34a64e-6415-41ab-b2ae-bee9b5c9d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.274661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcf4e0-b967-43c7-a78b-6ad9e6971d7a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.280332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.281815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.282487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.283023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.284073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.286047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.292624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 787/1545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:10:50.303140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.303490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.303713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.307759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 759/1546] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:50.313299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.328899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2e97-044f-4519-957c-2d688d624e44 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.339477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.340665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.341181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.343233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.344301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.346188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.359655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.360968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.364956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 760/1547] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:50.369321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.404765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46f0e2-61ea-4b1b-9fb5-a88055bbf14d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.409635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 788/1548] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:10:50.411563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.420442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.422208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.423061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.424856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] PATH_INFO: `/v3/projects/1d9f8e6eb55a4eadaed8caaeb23b3679/users/aea1409ec9d6433fab12147eee2a2d60/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.443536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2429-ef8a-4f9d-ab83-ceaaca14dab7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.483365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.484036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.484320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.484611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.485507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:50.485833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.488536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd8cd6-a180-4893-aa16-7fc3d43ec9e5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.496909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9f8e6eb55a4eadaed8caaeb23b3679, user_id=aea1409ec9d6433fab12147eee2a2d60, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.504280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.529823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 789/1549] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:50.531549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0205-f56d-4651-84e7-7a476670a703 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.532197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0205-f56d-4651-84e7-7a476670a703 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.532197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0205-f56d-4651-84e7-7a476670a703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.541390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 761/1550] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:50 2022] PUT /identity/v3/projects/1d9f8e6eb55a4eadaed8caaeb23b3679/users/aea1409ec9d6433fab12147eee2a2d60/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:50.550217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:50.588236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2b8a0205-f56d-4651-84e7-7a476670a703 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.589678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b8a0205-f56d-4651-84e7-7a476670a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.750077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1049-54f5-469d-9afc-89fb1bc8863e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:50.771761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:50.772915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.773441 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.774033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.776260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:50.780139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5959b-62b6-4401-8bc6-f7de51235b67 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:50.798851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 790/1551] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:50.801150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29324b-a0f2-445a-9477-07f6a21a8b11 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.801395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29324b-a0f2-445a-9477-07f6a21a8b11 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.801745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29324b-a0f2-445a-9477-07f6a21a8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.826965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0a29324b-a0f2-445a-9477-07f6a21a8b11 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.828443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0a29324b-a0f2-445a-9477-07f6a21a8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.828551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 762/1552] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:50.829838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a8be-212e-4ef0-83da-ec4cc4f41088 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.830333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a8be-212e-4ef0-83da-ec4cc4f41088 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.830634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a8be-212e-4ef0-83da-ec4cc4f41088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.855354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:50.869448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c1a4a8be-212e-4ef0-83da-ec4cc4f41088 None None] MFA Rules not processed for user `aea1409ec9d6433fab12147eee2a2d60`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.871943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c1a4a8be-212e-4ef0-83da-ec4cc4f41088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.920782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 791/1553] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:50.922320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb552-9048-4dc2-bd14-db64eab45ba9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.924563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb552-9048-4dc2-bd14-db64eab45ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.924563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb552-9048-4dc2-bd14-db64eab45ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.948364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-84edb552-9048-4dc2-bd14-db64eab45ba9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.949943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-84edb552-9048-4dc2-bd14-db64eab45ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.953483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 763/1554] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:50.954884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534aed-d2d3-44c3-a984-9ce629c3493a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.955273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534aed-d2d3-44c3-a984-9ce629c3493a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.955711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534aed-d2d3-44c3-a984-9ce629c3493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.958771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 792/1555] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:50.963953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb5fa-0a06-4b9c-a64d-efd78f100a18 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.964262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb5fa-0a06-4b9c-a64d-efd78f100a18 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.964683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb5fa-0a06-4b9c-a64d-efd78f100a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:50.982757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-44534aed-d2d3-44c3-a984-9ce629c3493a None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.984135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-44534aed-d2d3-44c3-a984-9ce629c3493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.991448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-db6cb5fa-0a06-4b9c-a64d-efd78f100a18 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:50.992508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 764/1556] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:50.992721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db6cb5fa-0a06-4b9c-a64d-efd78f100a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:50.993781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:50.994068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:50.994344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.009431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 793/1557] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.010839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b777-1940-4449-85c9-14bc7dc3c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.011113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b777-1940-4449-85c9-14bc7dc3c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.011395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b777-1940-4449-85c9-14bc7dc3c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.018915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.020199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.029795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 765/1558] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.030677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.033370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b0b1b777-1940-4449-85c9-14bc7dc3c3d8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.034750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b0b1b777-1940-4449-85c9-14bc7dc3c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.041903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7cd1d-e974-4334-b79b-8a1b49e6a0ff None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.047681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 794/1559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.048941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.049370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb3c-1e31-4605-ae62-6e38c3a8f9e2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.049651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb3c-1e31-4605-ae62-6e38c3a8f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.049864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.049978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb3c-1e31-4605-ae62-6e38c3a8f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.050162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.050474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.051241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.053231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.074680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9575eb3c-1e31-4605-ae62-6e38c3a8f9e2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.075915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9575eb3c-1e31-4605-ae62-6e38c3a8f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.084750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 766/1560] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.084750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.087913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 795/1561] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.089390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8f54-6d79-4547-a4d0-44e21da2e918 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.089760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8f54-6d79-4547-a4d0-44e21da2e918 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.090672 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8f54-6d79-4547-a4d0-44e21da2e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.107470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d079e4-e075-4512-8d85-ae7f5f406d14 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.112576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.113225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.113507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.113794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.114310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-40ac8f54-6d79-4547-a4d0-44e21da2e918 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.114574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.115590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-40ac8f54-6d79-4547-a4d0-44e21da2e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.116522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cff9b-d1cd-409e-b209-50ab73aa01d7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.124422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 796/1562] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.125730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74afd35-5b7c-4813-8a95-b422d847061e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.126052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74afd35-5b7c-4813-8a95-b422d847061e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.126551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74afd35-5b7c-4813-8a95-b422d847061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.146252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:51.163556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b74afd35-5b7c-4813-8a95-b422d847061e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.164532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 767/1563] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.165897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.166354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.166670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.168641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b74afd35-5b7c-4813-8a95-b422d847061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.192531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.193987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.243878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 797/1564] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.246249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.246759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.247222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.269068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:51.270281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:51.271402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 768/1565] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.278047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.279735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 798/1566] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:51.280756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.292684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99d5a-88a9-49dd-92dd-34e9110c31be None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.293000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af3a2c-427c-4f06-9c09-cee05aca9474 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.300854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.301105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.301925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.302039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.302351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.302510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.302856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.302984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.304047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.304173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.304550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.306917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.307252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.321977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 769/1567] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.327641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 799/1568] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:51.327869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.328018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.337150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59b73-f551-493b-941a-3db045393c4d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.346247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.348157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.348630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.349117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.350330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.350870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.351243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2135f-4d8f-46d9-8591-80643b6650af admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.353797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.358672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.359668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.360129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.360592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.361786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.362308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.365238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.375636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 800/1569] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.377007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.390527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 770/1570] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.391500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.403783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af17f6-81eb-489f-a142-5573259394bf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.404478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703a1c-eb4e-4b79-86b1-429f0549efaa admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.409146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.409777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.410085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.410360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.411180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.411389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.411948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.412400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.412871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.413834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.414016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.414407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.417260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.452530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 771/1571] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.452530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.452864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 801/1572] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.452864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.454150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126efc-eb53-4585-809f-bac29cd5b8ec admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.459137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.459791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.460132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.460411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.461140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.461453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.463159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.463462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba9a7-ad1c-4223-965b-2e05388b698c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.465917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:51.471205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.472150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.472583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.473038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.474182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:10:51.474519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.477752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.484544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 772/1573] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.492082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.501992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 802/1574] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:10:51.502884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.504560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a21d-5a5e-4a07-8b64-fb4c2b98912f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.510863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.512452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.512955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.513388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.514605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.515453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea988-2733-43ac-995f-afbd6f962aaf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.516722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.522537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.523290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.523752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.524241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.525541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.529179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.531429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 773/1575] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:51.532355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.545478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c68c04-3725-4077-a818-71020277b4de admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.552023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.553069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.553568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.554080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.555297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.559376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.562302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 803/1576] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.563188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.607314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 774/1577] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.609012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.655165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c738472-e526-4d87-baa1-f9d244ebe30b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.691106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:51.695106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf951-0491-4306-9fa1-8c52f56f7a7a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.703154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.703826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.704108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.704390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.705115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.706848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.721939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 775/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:51.722964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.730479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.731161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.731413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.731694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.732438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.734557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.740582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cde1a-c923-4c28-99b4-14505e04665c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.748804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.749923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.750327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.750700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.751712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.753835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.774072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 804/1579] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.775953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.790191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 776/1580] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.791199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.858239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b6d-885d-48b9-bed4-9fba2da7918e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.863462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.864124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.864378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b82a40-2e4a-467d-b6f2-e00a4592e740 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.864564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.864706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.865332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.867356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.870546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:51.871211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:51.871495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:51.871776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:51.872471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:51.874484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:51.899374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 805/1581] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.900367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.911606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 777/1582] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:51.912474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:51.945872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:51.985322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daceed-53bd-42c5-8ca5-b823f9c39a0a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:51.995985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba1ed-7b7a-4ca1-b200-4b2f9b48f754 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.002080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.003119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.003530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.003929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.004741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.006896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.030970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 778/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:51 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.032103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.043984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598018-ffdf-4d23-a0fa-0326ac02cebf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.049130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.049785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.050076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.050352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.051069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.053041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.063244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:52.078856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 779/1584] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.079980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.081409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.082077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.082501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.082828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] PATH_INFO: `/v3/projects/04bd0b93ac8140559e3ddfe51cc2cdaf/users/e7566583228946488bd1ab647bbe8059/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.091206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617019-b9b1-4ccd-875a-dde9eeeb533c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.096430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.097158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.097446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.097738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] PATH_INFO: `/v3/projects/dd4d453331e84edf9c16bcd60863d79f/users/53dfa1fdc78e42cabf3a14d8e4604016/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.110300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bd0b93ac8140559e3ddfe51cc2cdaf, user_id=e7566583228946488bd1ab647bbe8059, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.112237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:10:52.112237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:10:52.112237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:10:52.115982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d453331e84edf9c16bcd60863d79f, user_id=53dfa1fdc78e42cabf3a14d8e4604016, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.116498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.118864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.135183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 780/1585] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:52 2022] PUT /identity/v3/projects/dd4d453331e84edf9c16bcd60863d79f/users/53dfa1fdc78e42cabf3a14d8e4604016/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:52.136154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.144221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 806/1586] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:51 2022] PUT /identity/v3/projects/04bd0b93ac8140559e3ddfe51cc2cdaf/users/e7566583228946488bd1ab647bbe8059/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:52.145885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.225903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e315-4cd8-45c5-84e1-e135b3b98aa8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.238113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed28fe-df51-4b23-bcd0-4a9fe972eed5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.243171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.243827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.244148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.244431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.245124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.247971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.274237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 807/1587] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.274237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.283482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2882-0787-4ea0-88dd-e953b3e48b8b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.288754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.289398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.289686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.289968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.290757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.292760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.319995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 808/1588] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.320234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.320371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.320480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.320480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.320480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.320480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.322312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.330967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690c0f-b9b2-497b-92bc-d289d2202c4d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.337600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.338667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.339099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.339663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.341149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.344496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.345572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 781/1589] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.346546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.353306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:52.358243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9a39e-1fb9-43fc-ab01-38207839ae51 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.364992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.365729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.366152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.366608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.367483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.369276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.370381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 809/1590] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:52.371873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.386368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 782/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.386368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.394662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bbc64-fa3c-488d-89a7-4e08559bc40e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.396425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294c8e-ab9e-4186-941c-9996f057491a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.399928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.400562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.400844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.401120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.401823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.404019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075591b-ad4a-4eaa-b647-6b7907cb967f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.405814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.406964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.407489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.408198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.409516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.412779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.415660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 810/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.417078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.417391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.417646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.435879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 783/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.435879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.442646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:52.444413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:52.445833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87848d-1a04-4945-8883-8cec716cd392 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.451100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.451749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.452058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.452344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.453050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.454762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.454988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 811/1594] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:52.458226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.476298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 784/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.477133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969ffd-a299-4913-a6cd-242247cb505c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.477393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.490728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.491360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.491647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.492079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.492764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab272-dfaf-46f1-8e61-c57904c21602 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.492955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.494431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.498660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.499401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.499797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.500173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.501288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.503311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.506092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 812/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.507087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.517414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 785/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.518733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4d67-3839-40d7-90df-e23c4153fb83 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.518918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.524687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.525409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.525973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.526489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.528249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.530292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.531776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dc09b-efd4-4a10-b080-13afee8fc117 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.536477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.537109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.537395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.537674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.538389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.540070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.545330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 813/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.546609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.558314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 786/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.559174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.569576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bad9c-eefc-41ca-a0db-7b99ebb26607 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.570276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f4a6-5710-4887-b31f-c02ce7233a32 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.578247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.578666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.579069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.579484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.579865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.580185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.580398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.580689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] PATH_INFO: `/v3/projects/dd4d453331e84edf9c16bcd60863d79f/users/53dfa1fdc78e42cabf3a14d8e4604016/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.581322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.583609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.584350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d453331e84edf9c16bcd60863d79f, user_id=53dfa1fdc78e42cabf3a14d8e4604016, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.587159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.598238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 814/1600] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.599490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.601938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:52.605303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 787/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:52 2022] PUT /identity/v3/projects/dd4d453331e84edf9c16bcd60863d79f/users/53dfa1fdc78e42cabf3a14d8e4604016/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:52.607582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.658934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:52.687530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039c4d-160f-4dc3-bcaa-1955ab3fb656 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.714004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598751a-1f35-45ce-83ee-74922aa6a06f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.722715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.723810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.724327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.724837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.725985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.729197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.748385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 788/1602] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.748385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.748704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.748704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.748907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.749267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.760068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90780-2e5e-4dfa-96eb-f9678a3181fc admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.764704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.765454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.766114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.766397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.766544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.766703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.767728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.769349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.777914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 815/1603] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:52.778814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.785072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 789/1604] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.785072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.791901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2466d-4ef2-4ed2-a821-85c7d963609f service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.793665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521b3d-ee3e-462f-b917-ac043fb479ed admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.798743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.799061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.799701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.799853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.799985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.800264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.800372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.800667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.800985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.801506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.802785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.803366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.821180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 790/1605] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.821180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.821521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 816/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:52.821521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.829253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40105c4-d354-482b-bf58-45a112c2c847 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.831132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1928c-db9a-4bef-862b-d46c57cd948b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:52.834425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.835181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.835466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.835837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] PATH_INFO: `/v3/projects/76ff7a3700a24217bcd8474d46717c92/users/9e0305cbb5a9491c85a89d0b40cb821a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.838813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:52.839796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.840829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.841171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] PATH_INFO: `/v3/projects/d51be67fb4974085b55f3dcfcc2c70aa/users/cde9db32ba1c4810833f8fd824536347/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.855122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ff7a3700a24217bcd8474d46717c92, user_id=9e0305cbb5a9491c85a89d0b40cb821a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.858681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5780942-4eb2-4811-9c2e-eee2b8c5e0b3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.860619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51be67fb4974085b55f3dcfcc2c70aa, user_id=cde9db32ba1c4810833f8fd824536347, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:52.863495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:52.878029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 791/1607] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:52 2022] PUT /identity/v3/projects/76ff7a3700a24217bcd8474d46717c92/users/9e0305cbb5a9491c85a89d0b40cb821a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:52.879788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:52.880301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:52.880800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:52.882489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 817/1608] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:52 2022] PUT /identity/v3/projects/d51be67fb4974085b55f3dcfcc2c70aa/users/cde9db32ba1c4810833f8fd824536347/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:52.883816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:52.922792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] MFA Rules not processed for user `53dfa1fdc78e42cabf3a14d8e4604016`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:52.924570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:52.976461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:52.998914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35253d8-c111-4a00-a726-73794c53ca4b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:53.007518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:53.008702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.009224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.009726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] PATH_INFO: `/v3/projects/fbbed7fab4584f379dbefe4af9826544/users/42ce2627c0f142f8892c182f69ef9a39/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.030866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 792/1609] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.031791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.038246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbed7fab4584f379dbefe4af9826544, user_id=42ce2627c0f142f8892c182f69ef9a39, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:53.041585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:53.045997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf31b-b8ba-4946-aa2f-c6a32b0d5e7c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:53.051736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:53.052496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.052789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.053103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] PATH_INFO: `/v3/projects/5f0403222d4245f4b719ebfcd41b659f/users/dfafe594a33043b0b5a49dab19004def/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.061712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 818/1610] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:52 2022] PUT /identity/v3/projects/fbbed7fab4584f379dbefe4af9826544/users/42ce2627c0f142f8892c182f69ef9a39/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:53.063545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.077996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0403222d4245f4b719ebfcd41b659f, user_id=dfafe594a33043b0b5a49dab19004def, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:53.083604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:53.105472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 793/1611] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:53 2022] PUT /identity/v3/projects/5f0403222d4245f4b719ebfcd41b659f/users/dfafe594a33043b0b5a49dab19004def/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:53.106700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.130862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.163929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172b7a-1aab-4c33-9f0a-f6c234bab7a7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:53.257560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:53.258269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.258601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.258921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] PATH_INFO: `/v3/projects/4366bd8dc8874f489ff79143207d50a4/users/647441e1b389429aa7d8fe4ce4936ceb/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.259692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a811e3-1e0a-4733-af07-7b9f0a2f2d5c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:53.274575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:53.276456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.276945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.277934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] PATH_INFO: `/v3/projects/4d39663ede184e829860c30001d18261/users/924ccdeaf76745a3a1562be3ebfc8755/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.285139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4366bd8dc8874f489ff79143207d50a4, user_id=647441e1b389429aa7d8fe4ce4936ceb, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:53.289111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b58cc-9287-469f-a5f5-1c74000d4a88 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:53.311952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 819/1612] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:53 2022] PUT /identity/v3/projects/4366bd8dc8874f489ff79143207d50a4/users/647441e1b389429aa7d8fe4ce4936ceb/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:53.313513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.313943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.314402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.327977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d39663ede184e829860c30001d18261, user_id=924ccdeaf76745a3a1562be3ebfc8755, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:53.336393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b9ac-4946-470e-9237-4aac07dd34d9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:53.348424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.350221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.380978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 794/1613] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:53 2022] PUT /identity/v3/projects/4d39663ede184e829860c30001d18261/users/924ccdeaf76745a3a1562be3ebfc8755/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:53.383575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2d737-ebf2-4f7e-908b-a1b27f1e7b0d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.383870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2d737-ebf2-4f7e-908b-a1b27f1e7b0d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.384213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2d737-ebf2-4f7e-908b-a1b27f1e7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.413701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3ba2d737-ebf2-4f7e-908b-a1b27f1e7b0d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.417240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3ba2d737-ebf2-4f7e-908b-a1b27f1e7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.520176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 820/1614] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.525769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.568570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 795/1615] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.571031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981f34-6883-4e56-9661-d66352cca965 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.571784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981f34-6883-4e56-9661-d66352cca965 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.572537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981f34-6883-4e56-9661-d66352cca965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.605235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b3981f34-6883-4e56-9661-d66352cca965 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.606577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b3981f34-6883-4e56-9661-d66352cca965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.606880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c5db8-8aa6-44bd-b382-ba2e45ac3939 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:53.615118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 796/1616] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.616390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f92a-5985-4c25-9c93-e7dd0414cf07 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.616685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f92a-5985-4c25-9c93-e7dd0414cf07 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.616970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f92a-5985-4c25-9c93-e7dd0414cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.648525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.655768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f173f92a-5985-4c25-9c93-e7dd0414cf07 None None] MFA Rules not processed for user `dfafe594a33043b0b5a49dab19004def`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.657042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f173f92a-5985-4c25-9c93-e7dd0414cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.676050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.684782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:53.685773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.686087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.686343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.752140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 797/1617] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.753922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.754289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.754727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.791945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] MFA Rules not processed for user `647441e1b389429aa7d8fe4ce4936ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.794096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.800229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:53.804710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea60cb-d6ef-41a3-a727-2fa7e0c249b6 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:53.822074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 821/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:53.829148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:53.829555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:53.829922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:53.871054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 798/1619] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.873120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.877279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:53.885503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:53.911829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 822/1620] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:53.913712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:53.995806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbbd6e-c7d2-4a78-a847-1167baf4fd42 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.001643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.002825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.003230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.003688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.017589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.019958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.024124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982a301-3539-42b4-af17-a287e251aed1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.029587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.030828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.031535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.032123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.040124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 799/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.041733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.048205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.050038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.057536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0e09-31c3-4f63-9a3c-af70316fd2c3 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.064730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.065693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.065889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 823/1622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.066261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.067375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.068376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.087945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.090703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899b-9e85-49f0-b3b3-bf5198fb7015 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.093218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e6393-e114-4402-9273-f961ab3e698e service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.103974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.105077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.106667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.107265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.108609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.113145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.117923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 800/1623] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.120449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae33-eade-410d-8a72-4bb066d5a2a7 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.120927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae33-eade-410d-8a72-4bb066d5a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.121486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae33-eade-410d-8a72-4bb066d5a2a7 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.124622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 801/1624] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 3 12:10:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:10:54.126169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ae33-eade-410d-8a72-4bb066d5a2a7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.148967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ae33-eade-410d-8a72-4bb066d5a2a7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.157187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.158297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.158876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.161668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.181667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.185694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbe254-ac67-48e5-ad8b-01f464ee0c8f service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.195892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 824/1625] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:54 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:54.198729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.208813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 802/1626] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.211193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.211726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.212027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.295425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:54.301909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:54.305230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:54.347576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6f4da-97ef-4c55-be33-941e681776f5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.356634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.358275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.359151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.360397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.371779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:54.487803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.489229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.513671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 825/1627] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.516052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.521809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 803/1628] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 3 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:54.531501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.594603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d119115-e24b-4a9b-8aa6-7b5d29cf1bc1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.628046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.631949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.633536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.634869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.789059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d562d-0696-4668-92af-0ae3f589454f service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.824009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.825311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.828942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.829659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.831085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.842016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.842567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.847146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.879492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 804/1629] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:54.908808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 826/1630] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:54 2022] POST /identity/v3/users => generated 308 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:54.914947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.936102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b5d0-6c6a-4146-b18f-aa0b385b6fa4 service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.944185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.945796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.946089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.946422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:54.947431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:54.949399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:54.968032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 805/1631] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:54.974128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:54.989555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14734c5-6069-4921-b7f5-a495f0dbaea0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:54.997517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:54.998767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:54.999421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:54.999836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] PATH_INFO: `/v3/projects/c93f83637eb0452296b3a674aacfa52b/users/4e8770d907c945c6b79d4befa3d9c70a/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.036472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93f83637eb0452296b3a674aacfa52b, user_id=4e8770d907c945c6b79d4befa3d9c70a, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:55.040111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b893ea-57d6-471f-aee2-70b106385bbd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:55.076162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 827/1632] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:54 2022] PUT /identity/v3/projects/c93f83637eb0452296b3a674aacfa52b/users/4e8770d907c945c6b79d4befa3d9c70a/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:55.081664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:55.101265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d155f0-f8b5-40c6-8375-726b3c1a768a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:55.167009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b8bb-af7b-4e9b-85af-0ebc4be81c8f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.167750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b8bb-af7b-4e9b-85af-0ebc4be81c8f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.168296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b8bb-af7b-4e9b-85af-0ebc4be81c8f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.170524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 828/1633] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 3 12:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:10:55.177861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.179203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.180071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.210955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:55.212697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:55.292273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:55.292970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.293288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.293526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.296730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:55.301522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:55.333994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 806/1634] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:10:55.341983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:55.352019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 829/1635] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:55.364046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:55.364486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae39ef2-2b3c-44a3-a789-3618b0f2edea admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:55.371617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:55.377685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:55.378395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.378836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.379119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] PATH_INFO: `/v3/projects/c93f83637eb0452296b3a674aacfa52b/users/4e8770d907c945c6b79d4befa3d9c70a/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.384643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93f83637eb0452296b3a674aacfa52b, user_id=4e8770d907c945c6b79d4befa3d9c70a, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:55.389564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33077-fd7e-4f49-9940-d6d78139724f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:55.419838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 807/1636] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:10:55 2022] PUT /identity/v3/projects/c93f83637eb0452296b3a674aacfa52b/users/4e8770d907c945c6b79d4befa3d9c70a/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:10:55.442669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.443049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.443281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.482394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:55.494118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85aa1-6e07-4edd-a942-56bfe92f27b6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:55.508849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] MFA Rules not processed for user `4e8770d907c945c6b79d4befa3d9c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:55.511282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:55.648993 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:55.651715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.652942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.653467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.710895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 808/1637] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:10:55.726665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:55.742638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cef37-7f2f-4be8-97c1-932e193dc310 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:55.756289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:55.756951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:55.757249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:55.757534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:55.796088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:55.799398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:55.826834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:55.828808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e2e4-532a-41cd-aff2-c0e50ceec5cb service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:55.840528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 809/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:10:55.890426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 830/1639] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:10:56.524383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:56.765948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba00c-a751-4609-9296-ed95749f8f20 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:56.814028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:56.820731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:56.823233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:56.824567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] PATH_INFO: `/v3/users/dfafe594a33043b0b5a49dab19004def` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:56.828925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfafe594a33043b0b5a49dab19004def)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:56.836105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:57.095718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfafe594a33043b0b5a49dab19004def'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:10:57.141569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfafe594a33043b0b5a49dab19004def'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:10:57.234810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfafe594a33043b0b5a49dab19004def'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:10:57.276499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfafe594a33043b0b5a49dab19004def'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:10:57.278239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfafe594a33043b0b5a49dab19004def'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:10:57.284482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:57.294658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 810/1640] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:10:56 2022] DELETE /identity/v3/users/dfafe594a33043b0b5a49dab19004def => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:10:57.298433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31bd5-ac9b-488a-9f8a-59a287d8a8e2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:57.299266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31bd5-ac9b-488a-9f8a-59a287d8a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:57.299266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d31bd5-ac9b-488a-9f8a-59a287d8a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:57.359194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e5d31bd5-ac9b-488a-9f8a-59a287d8a8e2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:57.367000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e5d31bd5-ac9b-488a-9f8a-59a287d8a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:57.570546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:57.605967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 831/1641] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:57.640952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:57.642773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:57.825314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eceed-1a58-482b-8266-f657fb6b0dcc admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:57.845126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:57.845786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:57.846071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:57.846349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:57.884219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:57.896728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d019-3f09-42de-9013-fff480c7e34b service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:57.952276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 811/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:10:58.074729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631e1f-eb30-4062-86bb-e96fba66017e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:58.075202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631e1f-eb30-4062-86bb-e96fba66017e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:58.075552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631e1f-eb30-4062-86bb-e96fba66017e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:58.077330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 832/1643] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 3 12:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:10:58.089553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58af18-5d4e-4410-9110-b05709e577a3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:58.090369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58af18-5d4e-4410-9110-b05709e577a3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:58.090714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58af18-5d4e-4410-9110-b05709e577a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:58.133893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8c58af18-5d4e-4410-9110-b05709e577a3 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:58.138781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8c58af18-5d4e-4410-9110-b05709e577a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:58.263131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 812/1644] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 3 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:58.266812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:58.267763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:58.268108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:58.271416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 833/1645] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 3 12:10:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:10:58.282814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a790-b7ec-461c-b660-6ff3912f0ee3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:58.283608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a790-b7ec-461c-b660-6ff3912f0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:58.284135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a790-b7ec-461c-b660-6ff3912f0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:58.317701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b221a790-b7ec-461c-b660-6ff3912f0ee3 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:58.319452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b221a790-b7ec-461c-b660-6ff3912f0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:58.361313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 813/1646] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:10:58.373156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:58.375788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:58.508829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeba98-8d1c-415b-a1f9-254d0e092004 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:58.520963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:58.521692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:58.521988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:58.522272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:58.538186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:58.542869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:58.558906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 834/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:10:59.434202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:59.434202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:59.434202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:59.488867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] MFA Rules not processed for user `924ccdeaf76745a3a1562be3ebfc8755`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:10:59.493636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:59.643706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 814/1648] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:10:59 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:10:59.650142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:59.656075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:10:59.731542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57060768-2c9d-4240-94de-c95ee3e3f712 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:59.774096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:10:59.775683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:10:59.776203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:10:59.776698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:10:59.778406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:10:59.781763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:10:59.836023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 835/1649] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:10:59 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:10:59.840803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:10:59.864354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dcfcd-d165-46c6-81a3-64ffce2d0faa None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:10:59.889780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:00.036666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.037807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.038349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.038791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.039843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.042754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.087861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 815/1650] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:10:59 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:00.091881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.114228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad39bd-14a8-4c9b-9f00-cb6c6a261eb3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:00.131452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.132395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.132852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.133279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.134175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.136120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.150158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.152420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:00.175285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 836/1651] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:00.180380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.181750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa1b8-376d-4924-985f-494310f31030 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:00.226312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eec0c-55cf-46d6-8ad3-710e7da8fafd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:00.228146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.229199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.229637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.230046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] PATH_INFO: `/v3/projects/5f0403222d4245f4b719ebfcd41b659f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.232382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0403222d4245f4b719ebfcd41b659f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.233621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: WARNING py.warnings [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:11:00.233621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: warnings.warn(msg) Aug 03 12:11:00.233621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: Aug 03 12:11:00.235552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.247441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.248142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.248426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.248708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] PATH_INFO: `/v3/projects/5452ec73e56c414bab262be39791456b/users/8832ccf42d194592b539c283ee7c8834/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.303099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5452ec73e56c414bab262be39791456b, user_id=8832ccf42d194592b539c283ee7c8834, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.306456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.349709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 837/1652] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:00 2022] PUT /identity/v3/projects/5452ec73e56c414bab262be39791456b/users/8832ccf42d194592b539c283ee7c8834/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:00.352649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.356820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:00.438384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0403222d4245f4b719ebfcd41b659f', 'request_id': 'req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:00.464655 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0403222d4245f4b719ebfcd41b659f', 'request_id': 'req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:00.487864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0403222d4245f4b719ebfcd41b659f', 'request_id': 'req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:00.556159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] The token cache is being invalidate because project 5f0403222d4245f4b719ebfcd41b659f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:00.556513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:00.558297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:00.568729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 816/1653] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:00 2022] DELETE /identity/v3/projects/5f0403222d4245f4b719ebfcd41b659f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:00.571077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.583725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:00.630472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fef4a-bae7-42d7-a1c6-2a716b03ce3f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:00.814223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:00.853361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.857459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.858019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.862734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] PATH_INFO: `/v3/users/647441e1b389429aa7d8fe4ce4936ceb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.865213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647441e1b389429aa7d8fe4ce4936ceb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.866301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:11:00.866301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Aug 03 12:11:00.866301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: Aug 03 12:11:00.876218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.885428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f2eb4-ef8c-4e40-96b3-d1fa44c3d0d9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:00.916112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:00.917035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:00.917491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:00.918589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:00.921407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:00.925384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:00.952463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 817/1654] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:00.955034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:00.959964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:00.976840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f695b-3ff2-44fe-a1b0-a5f38fa14ea5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:01.004103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:01.005344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:01.005940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:01.006850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] PATH_INFO: `/v3/users/4e8770d907c945c6b79d4befa3d9c70a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:01.010718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8770d907c945c6b79d4befa3d9c70a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:01.021651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:01.094146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:01.110842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647441e1b389429aa7d8fe4ce4936ceb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.111562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647441e1b389429aa7d8fe4ce4936ceb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.164100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647441e1b389429aa7d8fe4ce4936ceb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.171751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8770d907c945c6b79d4befa3d9c70a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.189583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8770d907c945c6b79d4befa3d9c70a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.190885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647441e1b389429aa7d8fe4ce4936ceb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.191905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647441e1b389429aa7d8fe4ce4936ceb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.217938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 838/1655] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:00 2022] DELETE /identity/v3/users/647441e1b389429aa7d8fe4ce4936ceb => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:01.219220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:01.249656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:01.256976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8770d907c945c6b79d4befa3d9c70a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.286903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8770d907c945c6b79d4befa3d9c70a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.289346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3b53bc93-fb7b-4459-a3f9-c4d25bf91c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8770d907c945c6b79d4befa3d9c70a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:01.313890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 818/1656] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:00 2022] DELETE /identity/v3/users/4e8770d907c945c6b79d4befa3d9c70a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:01.317742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:01.321698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:01.322252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:01.383986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:01.383986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:01.448492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64338fad-40df-4961-b051-1e2818b13c23 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:01.581415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 819/1657] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:01.626907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:01.628191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:01.628780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:01.629298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] PATH_INFO: `/v3/projects/5452ec73e56c414bab262be39791456b/users/8832ccf42d194592b539c283ee7c8834/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:01.633662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5452ec73e56c414bab262be39791456b, user_id=8832ccf42d194592b539c283ee7c8834, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:01.639491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:01.664132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 839/1658] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:01 2022] PUT /identity/v3/projects/5452ec73e56c414bab262be39791456b/users/8832ccf42d194592b539c283ee7c8834/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:01.878855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:01.880587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:02.004516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd61bc-0fe1-418a-b535-0b14be78fc80 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:02.081725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:02.082751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:02.083367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:02.083989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:02.100277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:02.196488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:02.198591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95985d-c30d-4f9b-8afc-73d6121ae63e service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:02.219167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 820/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:03.398940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:03.402063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:03.432978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3951da-6000-41f3-9081-57b0f3dc78e3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:03.440825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:03.442219 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:03.442953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:03.444842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] PATH_INFO: `/v3/projects/c93f83637eb0452296b3a674aacfa52b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:03.448064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93f83637eb0452296b3a674aacfa52b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:03.465211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:03.482740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:03.596542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93f83637eb0452296b3a674aacfa52b', 'request_id': 'req-a25ae2a8-4631-41fa-973e-acea557a589d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:03.616056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93f83637eb0452296b3a674aacfa52b', 'request_id': 'req-a25ae2a8-4631-41fa-973e-acea557a589d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:03.640061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93f83637eb0452296b3a674aacfa52b', 'request_id': 'req-a25ae2a8-4631-41fa-973e-acea557a589d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:03.677961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] The token cache is being invalidate because project c93f83637eb0452296b3a674aacfa52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:03.678260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:03.684936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a25ae2a8-4631-41fa-973e-acea557a589d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:03.692157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 840/1660] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:03 2022] DELETE /identity/v3/projects/c93f83637eb0452296b3a674aacfa52b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:03.694330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:03.694984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:03.695156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:03.746764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:03.748998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:03.935864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 821/1661] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:03.947972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:03.948261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:03.949781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:03.993963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:03.995298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:04.022226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 841/1662] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:04.026723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.038944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada141-2805-4f5f-80d1-e90e05a77426 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.053274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.055249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.057312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.057851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.059237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:04.065505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.076261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.121938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 822/1663] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:04.125789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.140896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426bc3e-c486-4521-814c-e2c3d915243b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.156047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.156723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.157019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.157302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.157995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.161651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.244808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 842/1664] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:04 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:04.250557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.268889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d42c8-093e-48b5-9882-7b2a9af6d702 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.426217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.427083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.427385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.427676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.430752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.435456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.472667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 823/1665] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:04 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:04.477622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.498227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5773e-a741-4e2e-a6fc-a11b6faf9656 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.507099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.508150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.508596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.508965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.509933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.518522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.535142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 843/1666] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:04.539408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.553069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5e46a-6a66-4d55-b06a-9411f714a074 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.567693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.569025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.569485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.569796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.571542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.573484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a29f-2c0d-49af-9f70-2b09945869c4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.595332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 824/1667] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:04.602240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:04.631721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8fa41-945c-4fe8-acda-5e84f0e2c0cb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:04.643613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:04.644843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.645346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.645824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] PATH_INFO: `/v3/projects/626b31bc1d5e495ca9be3f94f911093d/users/75e86f64be09467fb80be264a0d12305/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.680995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=626b31bc1d5e495ca9be3f94f911093d, user_id=75e86f64be09467fb80be264a0d12305, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:04.700135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb35b-03de-47d7-abc2-fe986ae918bf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:04.742151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 844/1668] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:04 2022] PUT /identity/v3/projects/626b31bc1d5e495ca9be3f94f911093d/users/75e86f64be09467fb80be264a0d12305/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:04.754664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.755255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.755255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:04.823774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:04.860307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] MFA Rules not processed for user `75e86f64be09467fb80be264a0d12305`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:04.878939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:04.896794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:04.897344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:04.898056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.048000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] MFA Rules not processed for user `8832ccf42d194592b539c283ee7c8834`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:05.060455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:05.256548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 825/1669] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:05.262090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.273694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:05.329062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 845/1670] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:05.330031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.368419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:05.489800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba5fa-bfc2-4082-9399-66508d8f18c4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:05.495816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:05.496855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.497208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.497501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] PATH_INFO: `/v3/projects/4366bd8dc8874f489ff79143207d50a4` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.499069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4366bd8dc8874f489ff79143207d50a4)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:05.501464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:05.516884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47930625-942f-4b67-a5fe-cc6eeae86639 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:05.528725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:05.529476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.529941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.530045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.535042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:05.540091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:05.581337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 846/1671] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:05 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:05.584168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.623421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4366bd8dc8874f489ff79143207d50a4', 'request_id': 'req-511a3d1f-22bc-4edb-b3b3-f66300c033ae'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:05.636080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4366bd8dc8874f489ff79143207d50a4', 'request_id': 'req-511a3d1f-22bc-4edb-b3b3-f66300c033ae'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:05.649482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4366bd8dc8874f489ff79143207d50a4', 'request_id': 'req-511a3d1f-22bc-4edb-b3b3-f66300c033ae'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:05.679844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513d07f-c16e-454e-8bb5-2e2047737708 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:05.689160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] The token cache is being invalidate because project 4366bd8dc8874f489ff79143207d50a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:05.689504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:05.690210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-511a3d1f-22bc-4edb-b3b3-f66300c033ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:05.691957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:05.692725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 826/1672] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:05 2022] DELETE /identity/v3/projects/4366bd8dc8874f489ff79143207d50a4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:05.693843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.694398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.694960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.695821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:05.698254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80efcc-3b36-4604-af01-8fb272684bb4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.698693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80efcc-3b36-4604-af01-8fb272684bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.700408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80efcc-3b36-4604-af01-8fb272684bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.700910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:05.743039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 847/1673] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:05 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:05.744398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.746656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:05.760337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4d80efcc-3b36-4604-af01-8fb272684bb4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:05.767895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4d80efcc-3b36-4604-af01-8fb272684bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:05.768975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06cc0-18bd-4576-b71e-97ef8732397d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:05.782319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:05.782319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.782319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.785425 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.787530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:05.794002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:05.796661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 827/1674] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:05.806724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.808402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.809066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.833066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 848/1675] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:05.838933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.852193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b68c7-2be2-440d-b7e6-98d530230379 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:05.865309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:05.867783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:05.867783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:05.869029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] PATH_INFO: `/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f/users/28ae7661d4494d859fb85abe2b88c27f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:05.871210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:05.875344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:05.912555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d23303aaa61421bbf4920f9cbf36f9f, user_id=28ae7661d4494d859fb85abe2b88c27f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:05.915876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 828/1676] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:05.918997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:05.922068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:05.983255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0fae-352a-4543-b65c-d5bd67cde9ad None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.007751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 849/1677] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:05 2022] PUT /identity/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f/users/28ae7661d4494d859fb85abe2b88c27f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:06.011056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.032074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:06.178058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.178777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.179070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.179356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.180249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:06.180565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.187721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.202539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:06.208199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c423bf-a41e-4886-9d7e-64d8d1cb0177 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.221354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.225061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.225350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.225630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.229482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.232011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.236586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 829/1678] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:06.238518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.269218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 850/1679] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:06.270547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.302781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e3f8-ec4e-4de2-a970-6cc155a30ffa admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.313411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.315263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.316081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.316636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.317611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.317846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c87a6-cd9a-4940-aaea-9ffe2b48bd48 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.322749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.327225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.331671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.334407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.336934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] PATH_INFO: `/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f/users/28ae7661d4494d859fb85abe2b88c27f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.343288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d23303aaa61421bbf4920f9cbf36f9f, user_id=28ae7661d4494d859fb85abe2b88c27f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.352086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850b061-1cb0-40cd-a55d-32f7aa03aea5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.383745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 851/1680] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:06 2022] PUT /identity/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f/users/28ae7661d4494d859fb85abe2b88c27f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:06.397431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.397844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.398039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.470402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 830/1681] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:06 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:06.472961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.522523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] MFA Rules not processed for user `28ae7661d4494d859fb85abe2b88c27f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:06.524619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:06.648077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708b86b-0a72-45dd-96dd-c568dbc300ce admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.660271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.662274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.663757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.664539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.665239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.671858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.728853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 852/1682] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:06.734941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 831/1683] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:06 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:06.735444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.740581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:06.741456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.779985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5085bf6-69d1-43c5-a729-be000d97bd7a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.818333 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.822707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.823483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.825876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.841905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.853315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.900352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 832/1684] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:06.906398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:06.920815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00fa78-c0a9-4954-88da-40f6e9a74e55 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:06.934008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:06.935643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:06.937489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:06.938403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:06.939386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:06.947010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:06.984556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 833/1685] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:06.988430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:07.016420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffe79-fbe9-4b2a-aac1-f7875d4a7eeb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:07.034736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:07.039040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:07.039630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:07.044558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] PATH_INFO: `/v3/projects/9df422ac413748369c552de6e43d089e/users/95901ad361ee452da1e2684a88abdee3/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:07.046607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a063-3417-4b13-bf8b-84cf87b10825 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:07.059909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:07.061102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:07.061697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:07.062369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:07.109469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:07.124953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676fb8-af71-4f33-8d65-b1b96f93ded0 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:07.171985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df422ac413748369c552de6e43d089e, user_id=95901ad361ee452da1e2684a88abdee3, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:07.193579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:07.235676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 853/1686] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:07.271313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 834/1687] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:06 2022] PUT /identity/v3/projects/9df422ac413748369c552de6e43d089e/users/95901ad361ee452da1e2684a88abdee3/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:07.290185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:07.290895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:07.291525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:07.415758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] MFA Rules not processed for user `95901ad361ee452da1e2684a88abdee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:07.420573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:07.468789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:07.580979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:07.650096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19bdf-510c-4097-ae1a-b911f34190a4 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:07.659560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:07.659822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:07.661384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:07.661732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:07.662077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:07.665348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:07.681232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 854/1688] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:07.704674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:07.706711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:07.902515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393a4d-cb7c-4203-b2c1-671cf4a0060c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:07.906741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:07.911220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:07.912042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:07.912565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:07.912927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:07.920322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbdaf-157b-4285-a87e-2eaa2e698404 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:07.931462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:07.942733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:07.966250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 855/1689] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:07.988835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 835/1690] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:08.450581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:08.603826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778722e-ba4c-456b-99fa-28285086bcc8 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:08.611764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:08.613075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:08.613386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:08.613673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] PATH_INFO: `/v3/users/95901ad361ee452da1e2684a88abdee3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:08.615392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95901ad361ee452da1e2684a88abdee3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:08.617920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:08.772171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95901ad361ee452da1e2684a88abdee3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:08.773227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95901ad361ee452da1e2684a88abdee3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:08.808794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95901ad361ee452da1e2684a88abdee3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:08.825711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdcaa-9753-4cbc-b514-b49c4c030497 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:08.826001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdcaa-9753-4cbc-b514-b49c4c030497 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:08.826272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdcaa-9753-4cbc-b514-b49c4c030497 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:08.832956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 836/1691] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:11:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:08.849955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95901ad361ee452da1e2684a88abdee3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:08.853265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-64866cb5-488f-4a19-95ff-b3694a5d4785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95901ad361ee452da1e2684a88abdee3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:08.895315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 856/1692] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:08 2022] DELETE /identity/v3/users/95901ad361ee452da1e2684a88abdee3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:08.903850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:08.904162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:08.904444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:08.912007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86d10-1ca2-407b-9641-c6e87d9e0876 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:08.912420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86d10-1ca2-407b-9641-c6e87d9e0876 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:08.912685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86d10-1ca2-407b-9641-c6e87d9e0876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:08.926334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:08.962709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:08.965732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-88e86d10-1ca2-407b-9641-c6e87d9e0876 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:08.967087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:08.971097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88e86d10-1ca2-407b-9641-c6e87d9e0876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.186197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 837/1693] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:09.208223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 857/1694] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:11:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:09.270709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:09.272608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.304298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecda3-2d1b-45f2-a0ef-a42fd212565d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.304583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecda3-2d1b-45f2-a0ef-a42fd212565d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.304877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbecda3-2d1b-45f2-a0ef-a42fd212565d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.307408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 858/1695] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 3 12:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:11:09.319950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40156-c353-473b-89de-8e324823c19a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.320241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40156-c353-473b-89de-8e324823c19a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.320529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40156-c353-473b-89de-8e324823c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.348660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a8c40156-c353-473b-89de-8e324823c19a None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:09.352077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a8c40156-c353-473b-89de-8e324823c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.364450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 859/1696] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 3 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:09.365351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c40156-c353-473b-89de-8e324823c19a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:09.366973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a8c40156-c353-473b-89de-8e324823c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.383869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c40156-c353-473b-89de-8e324823c19a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:09.396392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:09.397580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.397580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.397996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] PATH_INFO: `/v3/users/aea1409ec9d6433fab12147eee2a2d60` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.401218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea1409ec9d6433fab12147eee2a2d60)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:09.411737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:09.464658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01e88-ed61-4241-bcf9-da41dabccea9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:09.478614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:09.479674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.480734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.481224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.496902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea1409ec9d6433fab12147eee2a2d60'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:09.499238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea1409ec9d6433fab12147eee2a2d60'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:09.502666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:09.504555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:09.517420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 838/1697] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:09.518873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:09.532551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0c48-53c2-4108-ac53-707ab5d7b7dd service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:09.533559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea1409ec9d6433fab12147eee2a2d60'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:09.546672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:09.547474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.547961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.549340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.557189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea1409ec9d6433fab12147eee2a2d60'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:09.558843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6f9b2d25-ce6d-439d-8e59-d250546bc533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea1409ec9d6433fab12147eee2a2d60'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:09.564208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.599827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:09.603813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532e011-3b4f-4c62-81f7-0d48fc680cd7 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:09.606601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 860/1698] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:09 2022] DELETE /identity/v3/users/aea1409ec9d6433fab12147eee2a2d60 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:09.609138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.611085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.612101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.628944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 839/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:09.629714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:09.630075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:09.630424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:09.658121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:09.659745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.677182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:09.693773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] MFA Rules not processed for user `e7566583228946488bd1ab647bbe8059`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:09.699183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.765290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 840/1700] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:09.773293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:09.776378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:09.809192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:09.836382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 861/1701] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:09.844849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:09.849190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:10.108267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd6940-6dad-41c2-8c5f-63f6c4b4afa5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:10.118836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaccbb4-6be9-4a15-8513-b7f9dd0cc9aa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:10.128972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:10.130023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:10.130495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:10.131009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:10.141003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:10.141699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:10.142044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:10.142622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:10.161559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:10.163428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:10.181053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:10.190079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:10.200238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 862/1702] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:10.246800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 841/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:11.316815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:11.319794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:11.380692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4060b-3da9-41a0-a3df-c65538975345 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:11.415159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:11.416205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:11.420514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:11.421025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] PATH_INFO: `/v3/projects/1d9f8e6eb55a4eadaed8caaeb23b3679` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:11.428202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9f8e6eb55a4eadaed8caaeb23b3679)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:11.457554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:11.735025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9f8e6eb55a4eadaed8caaeb23b3679', 'request_id': 'req-dbac87aa-4595-4adc-9d18-f50e849159c4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:11.758951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9f8e6eb55a4eadaed8caaeb23b3679', 'request_id': 'req-dbac87aa-4595-4adc-9d18-f50e849159c4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:11.785403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9f8e6eb55a4eadaed8caaeb23b3679', 'request_id': 'req-dbac87aa-4595-4adc-9d18-f50e849159c4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:11.836676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] The token cache is being invalidate because project 1d9f8e6eb55a4eadaed8caaeb23b3679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:11.837011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:11.842126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dbac87aa-4595-4adc-9d18-f50e849159c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:11.845665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 863/1704] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:11 2022] DELETE /identity/v3/projects/1d9f8e6eb55a4eadaed8caaeb23b3679 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:11.850028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:11.881250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895ea45-3c0e-4d65-a283-dcd012ffc098 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:11.966624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b1ae-2a03-4c23-b63b-0c35d3f0bef9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:11.966920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b1ae-2a03-4c23-b63b-0c35d3f0bef9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:11.967276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b1ae-2a03-4c23-b63b-0c35d3f0bef9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:11.969009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 864/1705] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:12.013483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:12.013818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:12.014687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:12.138930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] MFA Rules not processed for user `3848fce2cc0541499c45dee60acec543`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:12.141101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:12.226297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:12.231998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:12.233370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:12.234536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] PATH_INFO: `/v3/users/53dfa1fdc78e42cabf3a14d8e4604016` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:12.248389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dfa1fdc78e42cabf3a14d8e4604016)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:12.251372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:12.374566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dfa1fdc78e42cabf3a14d8e4604016'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.388962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:12.389543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dfa1fdc78e42cabf3a14d8e4604016'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.400958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:12.419110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 865/1706] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:12.421465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:12.423987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:12.426611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dfa1fdc78e42cabf3a14d8e4604016'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.441187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dfa1fdc78e42cabf3a14d8e4604016'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.441861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dfa1fdc78e42cabf3a14d8e4604016'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.455204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 842/1707] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:11 2022] DELETE /identity/v3/users/53dfa1fdc78e42cabf3a14d8e4604016 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:12.462674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66937094-34b7-4778-840d-9e3d104719b9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:12.503912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:12.505561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:12.642865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332fad8-1526-444d-ba58-c3fd533077ba admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:12.651594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:12.653785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:12.653785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:12.653785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:12.656067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:12.675545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:12.676400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:12.676694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:12.676979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] PATH_INFO: `/v3/users/924ccdeaf76745a3a1562be3ebfc8755` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:12.677084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:12.679268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] RBAC: Authorizing `identity:delete_user(user_id=924ccdeaf76745a3a1562be3ebfc8755)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:12.680460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd58311-d362-4827-acdd-4f8a769be27d service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:12.688288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:12.717737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 843/1708] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:12.879518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924ccdeaf76745a3a1562be3ebfc8755'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:12.880377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924ccdeaf76745a3a1562be3ebfc8755'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:13.029711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924ccdeaf76745a3a1562be3ebfc8755'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:13.056671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924ccdeaf76745a3a1562be3ebfc8755'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:13.059161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924ccdeaf76745a3a1562be3ebfc8755'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:13.096308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 866/1709] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:12 2022] DELETE /identity/v3/users/924ccdeaf76745a3a1562be3ebfc8755 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:13.669087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:13.669690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:13.669690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:13.753438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] MFA Rules not processed for user `42ce2627c0f142f8892c182f69ef9a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:13.757117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:13.800140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:13.805855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:14.049160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 844/1710] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:14.070850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:14.077323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:14.134188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8a30-0b5f-4d51-a5c6-3c088c3a330f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:14.156009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:14.157681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:14.157972 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:14.158417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] PATH_INFO: `/v3/projects/9df422ac413748369c552de6e43d089e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:14.162146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df422ac413748369c552de6e43d089e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:14.168504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:14.244167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:14.320890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:14.321890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df422ac413748369c552de6e43d089e', 'request_id': 'req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:14.343143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df422ac413748369c552de6e43d089e', 'request_id': 'req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:14.359267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df422ac413748369c552de6e43d089e', 'request_id': 'req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:14.377030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf4c46-4380-42d8-be99-4ada4f4946ab None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:14.395739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] The token cache is being invalidate because project 9df422ac413748369c552de6e43d089e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:14.395739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:14.397453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-da96e21a-7a5d-4c1a-a6b4-b11bd372cf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:14.403253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 867/1711] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:13 2022] DELETE /identity/v3/projects/9df422ac413748369c552de6e43d089e => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:14.405432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68925a6-9365-4a94-8f31-62fb21ce6c95 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:14.410812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68925a6-9365-4a94-8f31-62fb21ce6c95 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:14.411290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68925a6-9365-4a94-8f31-62fb21ce6c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:14.518304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d68925a6-9365-4a94-8f31-62fb21ce6c95 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:14.520962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d68925a6-9365-4a94-8f31-62fb21ce6c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:14.618194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:14.625018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:14.625299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:14.625681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:14.628477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:14.769173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:14.770880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:14.797091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 845/1712] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:14.798007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:14.799537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:14.952149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 868/1713] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:14.954808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:14.955319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:14.955824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:15.040075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:15.047706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:15.087501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 869/1714] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:15.092539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:15.126845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceda-cc35-46ce-8fff-541a8586a8ea service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:15.134535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0701027-5d7a-40d0-906d-afd1a4a57e55 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:15.136963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:15.138120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:15.138665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:15.139146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] PATH_INFO: `/v3/projects/4d39663ede184e829860c30001d18261` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:15.141338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d39663ede184e829860c30001d18261)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:15.148026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:15.169603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:15.170706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:15.171193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:15.171817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:15.174925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:15.179295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:15.185735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:15.205007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:15.222864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d39663ede184e829860c30001d18261', 'request_id': 'req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.251191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d39663ede184e829860c30001d18261', 'request_id': 'req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.254480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 870/1715] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:11:15.256301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:15.271228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d39663ede184e829860c30001d18261', 'request_id': 'req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.294739 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] The token cache is being invalidate because project 4d39663ede184e829860c30001d18261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:15.295512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.296809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.299657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 846/1716] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:14 2022] DELETE /identity/v3/projects/4d39663ede184e829860c30001d18261 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:15.302028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15141-b2d3-43cb-b3ef-f9e7a9bc0350 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:15.306169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:15.309386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:15.525336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:15.526629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:15.527152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:15.527592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:15.528940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:15.539366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:15.586877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 871/1717] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:15 2022] POST /identity/v3/projects => generated 371 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:15.588329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:15.590987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:15.609172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae0a8c-460c-4e31-bafc-c498be0fb7ba admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:15.613066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:15.792407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa502-4011-4be5-a39a-4fa39675b0ef admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:15.808879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:15.809609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:15.809899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:15.810252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] PATH_INFO: `/v3/projects/dd4d453331e84edf9c16bcd60863d79f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:15.814058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d453331e84edf9c16bcd60863d79f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:15.825402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:15.991890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:15.993995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d453331e84edf9c16bcd60863d79f', 'request_id': 'req-2545fada-af1d-41ef-b2c9-c6e11cd89c63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:15.995767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:15.996496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:15.997150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] PATH_INFO: `/v3/users/8832ccf42d194592b539c283ee7c8834` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:16.002852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8832ccf42d194592b539c283ee7c8834)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:16.010917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:16.011364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d453331e84edf9c16bcd60863d79f', 'request_id': 'req-2545fada-af1d-41ef-b2c9-c6e11cd89c63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.028583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d453331e84edf9c16bcd60863d79f', 'request_id': 'req-2545fada-af1d-41ef-b2c9-c6e11cd89c63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.092370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] The token cache is being invalidate because project dd4d453331e84edf9c16bcd60863d79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:16.092780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.096333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.106576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 872/1718] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:15 2022] DELETE /identity/v3/projects/dd4d453331e84edf9c16bcd60863d79f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:16.114151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:16.122083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:16.300889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8832ccf42d194592b539c283ee7c8834'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.321294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8832ccf42d194592b539c283ee7c8834'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.406094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8832ccf42d194592b539c283ee7c8834'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.418280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:16.481709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8832ccf42d194592b539c283ee7c8834'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.489782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ce194990-1657-45b6-9868-92edc75467af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8832ccf42d194592b539c283ee7c8834'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:16.539207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 847/1719] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:15 2022] DELETE /identity/v3/users/8832ccf42d194592b539c283ee7c8834 => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:16.541302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1e7-56d4-490e-a1af-74ee086882aa None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:16.541616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1e7-56d4-490e-a1af-74ee086882aa None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:16.542148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1e7-56d4-490e-a1af-74ee086882aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:16.584755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-58efd1e7-56d4-490e-a1af-74ee086882aa None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:16.588475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-58efd1e7-56d4-490e-a1af-74ee086882aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:16.639488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fada-af1d-41ef-b2c9-c6e11cd89c63 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:16.889048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:16.889691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 848/1720] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:16.907649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:16.908166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:16.908661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:16.946627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:16.948299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:16.949297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:16.952342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:16.955370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:16.964423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:16.981728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:16.984412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:17.016714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 849/1721] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:17.023752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.043274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 873/1722] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:16 2022] POST /identity/v3/users => generated 286 bytes in 936 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:17.052299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.053863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a696-c972-4858-bb0d-f2d806f092a2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.065599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:17.074707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.075941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.076480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.076982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.078384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:17.078924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.082631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.136264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091036-a1d5-4215-84a9-3156b27bd742 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.144720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 850/1723] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:17.146509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.157842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.158925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.159529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.159945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.161536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.166033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.204667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99857640-f186-4649-bdb5-a8d3cba0f76f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.222625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.224934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.225821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.226416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.227784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.242752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 874/1724] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:17.244925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.258721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f266ca-d194-4244-b7f2-6fe6759cdab4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.311203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7297ce-6ff9-4986-bc1b-91ef80abec2b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.349231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.350435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.350891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.352786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.354259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.358069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.415076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 875/1725] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:17.429159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.455480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 851/1726] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:17 2022] POST /identity/v3/projects => generated 369 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:17.463023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.463669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.464055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.478534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347262-0354-4d79-b492-582d255a046e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.565213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] MFA Rules not processed for user `e7566583228946488bd1ab647bbe8059`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:17.566844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:17.770850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.772314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.775158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.779362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] PATH_INFO: `/v3/projects/36b8b2a55a934185ac1a760323633b78/users/5cb1ab2bc0b04fad855f7e4948b38326/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.796458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 852/1727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:17.802860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.816570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5756fd-5c26-4c4c-9c6b-712738008531 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.823855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.824780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.825178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.825855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.826563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.829415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.880893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 853/1728] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:17 2022] POST /identity/v3/users => generated 285 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:17.888287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:17.913073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317cb34-79f9-40c7-8e4c-4e964d3ab45c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:17.932317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b8b2a55a934185ac1a760323633b78, user_id=5cb1ab2bc0b04fad855f7e4948b38326, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.945260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:17.950825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:17.951502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:17.951993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:17.953440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:17.956580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caba57-9cf8-40e4-bc5f-ee0e0aba9411 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:17.972856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:18.015725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 876/1729] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:17 2022] PUT /identity/v3/projects/36b8b2a55a934185ac1a760323633b78/users/5cb1ab2bc0b04fad855f7e4948b38326/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:18.030499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:18.030907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:18.031426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:18.035640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 854/1730] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:18.037356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:18.087207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efa50-6dca-4907-9570-0f815c22d07a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:18.172848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] MFA Rules not processed for user `5cb1ab2bc0b04fad855f7e4948b38326`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:18.179587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:18.252582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:18.513620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:18.523811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:18.524436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:18.525012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:18.539258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:18.544268 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:18.618745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 855/1731] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:18.627537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:18.760781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d15a6-777a-4620-a339-d34e90db0e36 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:18.782788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 877/1732] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 754 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:18.793952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:18.803605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:18.805449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:18.805449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:18.805882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] PATH_INFO: `/v3/projects/5458e3d65b584309954ed5abcd734958/users/931eda5c246b4a55a17f6e331c528243/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:18.860037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e37c-3056-4557-bf91-b5688d4a0118 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:18.899294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5458e3d65b584309954ed5abcd734958, user_id=931eda5c246b4a55a17f6e331c528243, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:18.910852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:18.916244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:18.917999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:18.919634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9948a-64e9-491a-b6be-f4ec77c9ee51 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:18.923067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:18.942618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:18.948030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.003239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 856/1733] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:18 2022] PUT /identity/v3/projects/5458e3d65b584309954ed5abcd734958/users/931eda5c246b4a55a17f6e331c528243/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:19.018141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.018869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.019900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.040521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 878/1734] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:18 2022] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:19.049708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.123482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:19.129947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] MFA Rules not processed for user `931eda5c246b4a55a17f6e331c528243`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:19.150500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:19.237778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542de8a-c8bb-4e87-8bbe-6198850d80d2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.245400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.247615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.249977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.250934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.259461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.272509 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.305754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 857/1735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:19.310055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.313285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 879/1736] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:19 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:19.319246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.339453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed121-eb12-4381-a9a5-85f8ae9801bc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.339907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5155-45cd-47b5-9828-6c25a5a70f21 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.349814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.352562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.353208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.353703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.354048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.354329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.355484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.355795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.356539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.358308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.360350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.362565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.392400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 880/1737] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:19.398198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.414826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f03-370a-4014-b5fc-4ad9e5655487 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.430751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 858/1738] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:19 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:19.431476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.432195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.432479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.432759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] PATH_INFO: `/v3/projects/fb994b65ad4c41bbbf84d28a98179716/users/df6f6625fe3c4a04b65bfe8edb845a67/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.437051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.494678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb994b65ad4c41bbbf84d28a98179716, user_id=df6f6625fe3c4a04b65bfe8edb845a67, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.497574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.543710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 881/1739] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:19 2022] PUT /identity/v3/projects/fb994b65ad4c41bbbf84d28a98179716/users/df6f6625fe3c4a04b65bfe8edb845a67/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:19.550662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.601485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f01ae0-ed78-4f2c-82be-cfa7f3ebe52e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.623276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:19.744571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.745665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.746824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.747323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.748485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.751528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.793975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096149d-f70d-42bb-92ae-95f2e5f0b61a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.817829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 859/1740] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:19 2022] POST /identity/v3/users => generated 291 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:19.824280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.831684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.834934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.835411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.838208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.840014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.847278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d826-ff16-41c0-bf1f-14fc075dbd70 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.847507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.853789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.854682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.855442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.855442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.856334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.858985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.875838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 860/1741] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:19.882802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.897550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabe8ad-63d8-4c30-8bfa-c9d9e5f05596 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.906723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.907868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.908482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.908984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] PATH_INFO: `/v3/projects/560f17f360de4203b9b3a1d02f1e2682/users/41ccb62cb04f472cad9506c74588c463/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.913261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 882/1742] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:19.920324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:19.943519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560f17f360de4203b9b3a1d02f1e2682, user_id=41ccb62cb04f472cad9506c74588c463, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.948346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:19.954404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7be1a1-9dc5-4c2d-96f2-98b317f11efe admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:19.978766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:19.980705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:19.981793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:19.982667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] PATH_INFO: `/v3/projects/fb994b65ad4c41bbbf84d28a98179716/users/df6f6625fe3c4a04b65bfe8edb845a67/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:19.996220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb994b65ad4c41bbbf84d28a98179716, user_id=df6f6625fe3c4a04b65bfe8edb845a67, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:19.996717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 861/1743] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:19 2022] PUT /identity/v3/projects/560f17f360de4203b9b3a1d02f1e2682/users/41ccb62cb04f472cad9506c74588c463/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:20.004636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0ca3-44a7-4d53-b293-f856c86c7baf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:20.010271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:20.031745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 883/1744] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:19 2022] PUT /identity/v3/projects/fb994b65ad4c41bbbf84d28a98179716/users/df6f6625fe3c4a04b65bfe8edb845a67/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:20.059394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb328c5-16e8-4622-b612-395e06b14acf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:20.059687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb328c5-16e8-4622-b612-395e06b14acf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:20.060052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb328c5-16e8-4622-b612-395e06b14acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:20.126172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0117e-b01e-4431-9c80-35198572c8e2 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:20.126581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cfb328c5-16e8-4622-b612-395e06b14acf None None] MFA Rules not processed for user `df6f6625fe3c4a04b65bfe8edb845a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:20.127984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cfb328c5-16e8-4622-b612-395e06b14acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:20.227366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:20.228167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:20.228478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:20.228839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:20.230519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:20.236323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:20.258306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 862/1745] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:20.259678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:20.277276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8d74-7790-4afc-a754-6827fca17d95 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:20.284502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:20.285339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:20.286139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:20.287097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] PATH_INFO: `/v3/projects/560f17f360de4203b9b3a1d02f1e2682/users/41ccb62cb04f472cad9506c74588c463/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:20.291182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] RBAC: Authorizing `identity:create_grant(project_id=560f17f360de4203b9b3a1d02f1e2682, user_id=41ccb62cb04f472cad9506c74588c463, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:20.295012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:20.311038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:20.324187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 863/1746] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:20 2022] PUT /identity/v3/projects/560f17f360de4203b9b3a1d02f1e2682/users/41ccb62cb04f472cad9506c74588c463/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:20.343995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:20.349577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:20.391741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:20.500141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 884/1747] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:20.506388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:20.506727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:20.507038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:20.539285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd183-f043-4dec-a984-90e44cdadbae admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:20.555890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:20.557727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:20.558790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:20.559558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] PATH_INFO: `/v3/users/75e86f64be09467fb80be264a0d12305` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:20.562358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e86f64be09467fb80be264a0d12305)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:20.571437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:20.574626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] MFA Rules not processed for user `41ccb62cb04f472cad9506c74588c463`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:20.575986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:20.755042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e86f64be09467fb80be264a0d12305'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:20.788781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e86f64be09467fb80be264a0d12305'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:20.813362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e86f64be09467fb80be264a0d12305'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:20.830894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e86f64be09467fb80be264a0d12305'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:20.832764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e86f64be09467fb80be264a0d12305'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:20.861695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 864/1748] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:20 2022] DELETE /identity/v3/users/75e86f64be09467fb80be264a0d12305 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:20.861912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 885/1749] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:20.861912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:20.868115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:20.873940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:20.876820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:20.939231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9213e-6a7c-4e03-bdee-24913dbaca83 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:21.089771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:21.090765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.091061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.091349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] PATH_INFO: `/v3/projects/5452ec73e56c414bab262be39791456b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.103147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5452ec73e56c414bab262be39791456b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:21.105460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:21.108058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532a2c-e238-42fe-8e69-afec1c910a6b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:21.129915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:21.131520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.141320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.141851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.145956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:21.209137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5452ec73e56c414bab262be39791456b', 'request_id': 'req-a67b98a9-32db-421e-a259-188bb98088b2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:21.220040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5452ec73e56c414bab262be39791456b', 'request_id': 'req-a67b98a9-32db-421e-a259-188bb98088b2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:21.223406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:21.234795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5452ec73e56c414bab262be39791456b', 'request_id': 'req-a67b98a9-32db-421e-a259-188bb98088b2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:21.260054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] The token cache is being invalidate because project 5452ec73e56c414bab262be39791456b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:21.264546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:21.265374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:21.266096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a67b98a9-32db-421e-a259-188bb98088b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:21.273731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 886/1750] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:20 2022] DELETE /identity/v3/projects/5452ec73e56c414bab262be39791456b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:21.273731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47d53-fc2d-40ad-95a9-59a5d5de0999 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.273731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47d53-fc2d-40ad-95a9-59a5d5de0999 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.273731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47d53-fc2d-40ad-95a9-59a5d5de0999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.350368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:21.352102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:21.371525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 865/1751] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:21.373393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:21.376572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:21.396034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b8a47d53-fc2d-40ad-95a9-59a5d5de0999 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:21.400503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b8a47d53-fc2d-40ad-95a9-59a5d5de0999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:21.411523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86171e-ebba-4dfd-946c-1eb33289a654 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:21.506375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:21.506375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.506375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.506375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.508742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:21.603512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:21.606652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592dc7b-7cde-469f-8e07-7ff179972c8d service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:21.635378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 866/1752] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:21.636562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf1f0-c40f-4357-8c94-3c062c07dfe1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.636907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf1f0-c40f-4357-8c94-3c062c07dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.641478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf1f0-c40f-4357-8c94-3c062c07dfe1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.645515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 867/1753] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 3 12:11:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:21.646912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bec78-025f-445c-b268-0de996f207de None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.647180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bec78-025f-445c-b268-0de996f207de None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.647466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bec78-025f-445c-b268-0de996f207de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.709700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e41bec78-025f-445c-b268-0de996f207de None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:21.712885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e41bec78-025f-445c-b268-0de996f207de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:21.720618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 887/1754] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:21.725934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.726372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.727403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.762489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 868/1755] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:21.762489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:21.762489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:21.762489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:21.823133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] MFA Rules not processed for user `cde9db32ba1c4810833f8fd824536347`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:21.825275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.011449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.012737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.154261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 888/1756] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.155223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.156728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.189230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 869/1757] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.190198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4bd9-9110-4e09-a1a4-474940addc10 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:22.190368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.191971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.196171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:22.196828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.197287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.197593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.200753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.212718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d8c2-c2c1-48dc-9856-6c4f79a3f120 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:22.233693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:22.234423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.234791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.235073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.263416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:22.271880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:22.273829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c76b-01cf-40fd-8c6c-b484e19fc5ab service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:22.300202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 870/1758] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:22.304069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527cc9-deb5-43b8-b552-bd6d4d2c23c2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.304456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527cc9-deb5-43b8-b552-bd6d4d2c23c2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.304638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527cc9-deb5-43b8-b552-bd6d4d2c23c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.306331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:22.309967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:22.363762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 889/1759] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:22.365195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.368260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.378119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1d527cc9-deb5-43b8-b552-bd6d4d2c23c2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.379669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1d527cc9-deb5-43b8-b552-bd6d4d2c23c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.399621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e419-7675-4eb2-854e-9a3db0103dce service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:22.411582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:22.411856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.412022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.412308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.413404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 871/1760] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.419659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.419965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.420258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.424865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.455609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:22.502912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] MFA Rules not processed for user `9e0305cbb5a9491c85a89d0b40cb821a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.504962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.600004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:22.603319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922fb8f-a85a-4b13-8333-f3e4553c6c43 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:22.631009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 890/1761] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:22.636034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.636034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.637135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.697747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] MFA Rules not processed for user `cde9db32ba1c4810833f8fd824536347`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.702416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 872/1762] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.717865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.720898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.722627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.733718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 891/1763] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.740512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.758414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cd213-485a-46d4-ac1c-e960779aa81d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:22.765742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:22.767655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.767655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.767655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.768384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:22.768766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:22.770596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86f48-a22b-4936-b62c-fb6ca25d7e05 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:22.779809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a6dcf-b9a4-4366-bf10-0cf34404a95b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:22.791018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 892/1764] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:22.793169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:22.793706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.793893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.794116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.794273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.794421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.794653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.817337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:22.819994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52061-af82-461a-88b9-9392893ad5e2 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:22.839003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] MFA Rules not processed for user `42ce2627c0f142f8892c182f69ef9a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.842029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 873/1765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:22.845002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.846736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:22.847106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:22.847394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:22.911792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] MFA Rules not processed for user `9e0305cbb5a9491c85a89d0b40cb821a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:22.915146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.935520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 874/1766] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.939752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:22.947686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:22.982554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 893/1767] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:22.983439 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.014401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d8fb-df65-4723-896a-53e0f5722406 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.028187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.028999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.028999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.030280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.031079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.041565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.134925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 894/1768] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:22 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:23.136451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.154213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ba63f-c95c-41f0-a3c1-bc02cb2d9ea7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.338749 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:23.373597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.374851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.375258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.375412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c308-231b-4ddf-8080-cace40944ea7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.375717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.390278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.391048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.391446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.392978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.393810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.396096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.456751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 895/1769] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:23 2022] POST /identity/v3/users => generated 282 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:23.457783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.490598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.492806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.505895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e4128-f91e-403a-ae5a-8a05a75ac536 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.507947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 875/1770] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:23.515840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.517035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.517958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.519675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.521202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.524241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.527941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:23.564387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 896/1771] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:23.570061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.591866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084178e5-0696-4135-8b57-d32057e77fa2 service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.603262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.605687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.605942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.606212 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.607265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.610095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.629343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 876/1772] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:23.644314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.684648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.687777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:23.690428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c48c0-7fa5-4b0a-b8c4-e4e4386946c9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.715797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8cb-3187-4312-b52c-1da9d6516873 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:23.721483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.722238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.722590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.722885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] PATH_INFO: `/v3/projects/626b31bc1d5e495ca9be3f94f911093d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.724294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626b31bc1d5e495ca9be3f94f911093d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.726415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.726786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:23.730542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.731246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.731975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] PATH_INFO: `/v3/projects/fd4759f018e44b8f9305861b0b4f1a43/users/f6e6b108e78c47ae9eb6db2287591e78/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.762175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4759f018e44b8f9305861b0b4f1a43, user_id=f6e6b108e78c47ae9eb6db2287591e78, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:23.770298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937074cf-fc95-4bcb-a5d8-1e081aec8264 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:23.818204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 897/1773] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:23 2022] PUT /identity/v3/projects/fd4759f018e44b8f9305861b0b4f1a43/users/f6e6b108e78c47ae9eb6db2287591e78/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:23.818499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626b31bc1d5e495ca9be3f94f911093d', 'request_id': 'req-034cb7be-a1e4-4227-a187-25b3dc2504a5'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:23.837331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:23.838144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:23.839282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:23.844882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626b31bc1d5e495ca9be3f94f911093d', 'request_id': 'req-034cb7be-a1e4-4227-a187-25b3dc2504a5'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:23.882204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626b31bc1d5e495ca9be3f94f911093d', 'request_id': 'req-034cb7be-a1e4-4227-a187-25b3dc2504a5'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:23.914865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] MFA Rules not processed for user `f6e6b108e78c47ae9eb6db2287591e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:23.920758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:23.920932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] The token cache is being invalidate because project 626b31bc1d5e495ca9be3f94f911093d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:23.921121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:23.921871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:23.927566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 877/1774] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:23 2022] DELETE /identity/v3/projects/626b31bc1d5e495ca9be3f94f911093d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:23.928590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:23.930121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.068589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cb7be-a1e4-4227-a187-25b3dc2504a5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:24.088844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:24.158031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 898/1775] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:24.164188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:24.165782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.253529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:24.255005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:24.255463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:24.255896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] PATH_INFO: `/v3/users/28ae7661d4494d859fb85abe2b88c27f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:24.257605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ae7661d4494d859fb85abe2b88c27f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:24.261487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:24.379057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ae7661d4494d859fb85abe2b88c27f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:24.404527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983413c8-75b2-4851-8ef8-d8195c329ddf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:24.405826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ae7661d4494d859fb85abe2b88c27f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:24.415699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:24.416915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:24.417692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:24.418373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:24.420021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:24.424224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:24.438951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ae7661d4494d859fb85abe2b88c27f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:24.455302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ae7661d4494d859fb85abe2b88c27f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:24.456166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ae7661d4494d859fb85abe2b88c27f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:24.471751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 878/1776] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:23 2022] DELETE /identity/v3/users/28ae7661d4494d859fb85abe2b88c27f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:24.478468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:24.481454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.517109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 899/1777] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:24 2022] POST /identity/v3/projects => generated 365 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:24.519099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:24.522546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.692593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:24.737773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba9e3f-0d22-4cd2-888a-9f8c5d2d1188 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:24.743256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:24.743918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:24.746838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:24.747317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:24.755665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.782530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:24.784195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8693b-c386-4e5b-8e3a-e1fa366b0f68 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:24.811116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 900/1778] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:24.812270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:24.812562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:24.812983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:24.821136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 901/1779] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 3 12:11:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:24.823248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:24.828200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:24.834929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1c3ff-42b5-485e-a9c5-bfb288b55699 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:24.976244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:25.002254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfc5d2-076f-42f2-a963-54abf631203e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.017957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.022055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.022926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.023398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.026566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.031166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b192edd-b66c-4cbc-b2db-c5d475ab8494 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.098737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 902/1780] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:24 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:25.102479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.105391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.105835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.116758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.117479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.119546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.120001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.126213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:25.171512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:25.185727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:25.343808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.347887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.368497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 879/1781] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 895 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:25.369411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.371992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 903/1782] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:11:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:25.383381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75756b9-01cf-4526-b6e4-14fde958a2f5 service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.401064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.402397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.402738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.403018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.403739 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.405439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.433351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 880/1783] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:25.435768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.465066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e9950-62e2-4db8-89d9-42b25508988a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.485717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.486869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.487298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.487718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] PATH_INFO: `/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e/users/8b52d5b157aa4b0f8316156758145f21/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.538078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.548588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:25.567007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc39f8a3ca4c4497956b3917b55b7e, user_id=8b52d5b157aa4b0f8316156758145f21, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.569813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.601859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 904/1784] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:25 2022] PUT /identity/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e/users/8b52d5b157aa4b0f8316156758145f21/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:25.610012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.627031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9344ca-dac9-416d-890b-e5cfbefe1a6c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.811278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:25.850373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.851055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.851347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.851631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.858158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54ac1-14da-42b2-a867-3a9fde1e1c07 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.873780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.874291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.874622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.874922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.875641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.881455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.883963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.887646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:25.923579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 881/1785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:25.929087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 905/1786] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:25.930295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.936240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:25.937834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:25.976320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8b71c-e069-4b8d-8600-cc7ecf1814cc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:25.984499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:25.985269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:25.985561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:25.985843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] PATH_INFO: `/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e/users/8b52d5b157aa4b0f8316156758145f21/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:25.992522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc39f8a3ca4c4497956b3917b55b7e, user_id=8b52d5b157aa4b0f8316156758145f21, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:25.996758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66a869-d774-4315-a7c1-1311a1ad051a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:26.021470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 906/1787] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:25 2022] PUT /identity/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e/users/8b52d5b157aa4b0f8316156758145f21/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:26.026066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501bc9-e2e2-444a-9b5a-094777b78a59 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:26.034382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:26.035464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:26.035760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:26.126355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] MFA Rules not processed for user `8b52d5b157aa4b0f8316156758145f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:26.127345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:26.406430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:26.430011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:26.440500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:26.441145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:26.449515 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] PATH_INFO: `/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:26.457495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d23303aaa61421bbf4920f9cbf36f9f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:26.477174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:26.666539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 907/1788] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 634 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:26.695686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:26.700639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:26.837112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d23303aaa61421bbf4920f9cbf36f9f', 'request_id': 'req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:26.862263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d23303aaa61421bbf4920f9cbf36f9f', 'request_id': 'req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:26.899381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d23303aaa61421bbf4920f9cbf36f9f', 'request_id': 'req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:26.956265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca962d-a151-49be-a81f-71764d9dc8f9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:27.037252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] The token cache is being invalidate because project 0d23303aaa61421bbf4920f9cbf36f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:27.037732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:27.056754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-17f72745-4f42-4e0b-b98a-86b7c2e5fa01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:27.066722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 882/1789] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:25 2022] DELETE /identity/v3/projects/0d23303aaa61421bbf4920f9cbf36f9f => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:27.078850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851133-4a5d-47c2-a987-7deec44761c3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.079424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851133-4a5d-47c2-a987-7deec44761c3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.079869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851133-4a5d-47c2-a987-7deec44761c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.140411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f2851133-4a5d-47c2-a987-7deec44761c3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:27.148306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f2851133-4a5d-47c2-a987-7deec44761c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:27.251890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:27.253504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.254328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.254938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.259485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:27.402888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 883/1790] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:27.415312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.416007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.416007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.489874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:27.491996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:27.493380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:27.509036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 884/1791] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:27.510738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:27.540459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bb002-d68b-4c9f-a0c7-b97636904cdc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:27.552151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:27.552813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.553105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.553405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.554506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:27.554506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:27.557233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:27.601990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 885/1792] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:11:27.607686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:27.624219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208817c-0da7-4b13-a2b7-727f5d54b428 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:27.629652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:27.630551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.630809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.631390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.633605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:27.634593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:27.663090 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:27.669145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:27.690571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 908/1793] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 996 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:27.725390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 886/1794] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:27.727276 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:27.744947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1de5a-9703-4834-a2fd-3ca7b397519e service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:27.919189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:27.919838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:27.920741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:27.921027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:27.921977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:27.925551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:27.962503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 909/1795] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:27 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:27.965770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:28.010077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2fd1-dd2e-4ba9-84fd-f471747544cc admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:28.025850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:28.030091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:28.033723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.034229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.034751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.035693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:28.039272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:28.039669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:28.070346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 887/1796] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:28.071892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:28.084964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbebba-054e-42ff-9231-ab29601aa3c3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:28.094025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:28.095056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.095586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.096090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.097321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:28.099454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:28.120025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 888/1797] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:28.121596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:28.149621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f29ec-16bc-4952-853e-ac63f1b1bee9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:28.171763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:28.173215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.173896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.176111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] PATH_INFO: `/v3/projects/2c84b25662454652b1a25919dec84481/users/93afce32e4854c87929a419210fc4cb6/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.210421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c84b25662454652b1a25919dec84481, user_id=93afce32e4854c87929a419210fc4cb6, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:28.213885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b76-7eb9-4070-94c4-a5ddfb6cc9c9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:28.235824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:28.252100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 889/1798] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:28 2022] PUT /identity/v3/projects/2c84b25662454652b1a25919dec84481/users/93afce32e4854c87929a419210fc4cb6/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:28.254668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.256952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.257882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.325533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] MFA Rules not processed for user `93afce32e4854c87929a419210fc4cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:28.327633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:28.454887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91057e3-875c-4cdd-bcba-f1368cbe433e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:28.553498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 890/1799] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:28.558394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:28.674137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:28.675391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.675892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.676408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.680688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:28.754522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:28.904039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:28.905543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:28.919939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8012-a056-4dad-bc11-1842c71cb3d2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:28.944279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:28.944955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:28.945342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:28.945627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:28.949417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 910/1800] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 925 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:28.951836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:28.957028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a96d-3750-4732-9597-e48012ca80bb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:29.038970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 891/1801] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:28 2022] POST /identity/v3/projects => generated 377 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:29.040804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:29.108256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bcb35-ffe9-407d-9c66-39deb8649460 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:29.427528 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:29.428310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:29.428595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:29.428855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:29.432922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:29.454563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:29.482330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:29.482652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:29.483481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:29.532739 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 911/1802] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:29 2022] POST /identity/v3/users => generated 295 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:29.536113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:29.543038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] MFA Rules not processed for user `cde9db32ba1c4810833f8fd824536347`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:29.545576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:29.578662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1e26-2fa9-45af-8bf0-76c6e37ce67b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:29.604092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:29.605264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:29.605501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:29.605789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:29.606564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:29.608258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:29.644472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 912/1803] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:29.653491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:29.697058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62921-8e28-46a5-b02f-6ab34f62066e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:29.712038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:29.712764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:29.713218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:29.713516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] PATH_INFO: `/v3/projects/d87f95fa8b9847ee970761ec8298f34d/users/6183320c5fd546dea3e45b2f9dd36597/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:29.763600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 892/1804] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:29.763600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:29.763600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:29.769292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87f95fa8b9847ee970761ec8298f34d, user_id=6183320c5fd546dea3e45b2f9dd36597, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:29.781064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:29.787028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c595-3e8a-4a1c-8b15-be58ad6f7e49 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:29.815850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:29.816973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:29.817345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:29.817697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] PATH_INFO: `/v3/users/931eda5c246b4a55a17f6e331c528243` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:29.819685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931eda5c246b4a55a17f6e331c528243)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:29.822314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:29.832750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 913/1805] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:29 2022] PUT /identity/v3/projects/d87f95fa8b9847ee970761ec8298f34d/users/6183320c5fd546dea3e45b2f9dd36597/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:29.835549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:29.863004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:30.007667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931eda5c246b4a55a17f6e331c528243'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:30.022925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931eda5c246b4a55a17f6e331c528243'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:30.106209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931eda5c246b4a55a17f6e331c528243'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:30.126850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931eda5c246b4a55a17f6e331c528243'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:30.130582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f3d66c52-4079-48e1-9a3c-df3bbac9d2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931eda5c246b4a55a17f6e331c528243'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:30.171426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 893/1806] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:29 2022] DELETE /identity/v3/users/931eda5c246b4a55a17f6e331c528243 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:30.174991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07920bf-4a9f-4b10-b349-8087dc4add94 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:30.179127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:30.179491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:30.179780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:30.242139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:30.282071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:30.290054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:30.322933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:30.324063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:30.324407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:30.324756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:30.325734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:30.332227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:30.360560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 914/1807] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:30.365863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:30.369000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:30.401032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c10fd-b514-404f-937e-edede016762e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:30.416308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:30.417592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:30.417877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:30.418127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] PATH_INFO: `/v3/projects/d87f95fa8b9847ee970761ec8298f34d/users/6183320c5fd546dea3e45b2f9dd36597/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:30.420474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87f95fa8b9847ee970761ec8298f34d, user_id=6183320c5fd546dea3e45b2f9dd36597, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:30.423971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c24db-c85e-4078-9de5-74c8bfdf3b95 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:30.474732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 915/1808] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:30 2022] PUT /identity/v3/projects/d87f95fa8b9847ee970761ec8298f34d/users/6183320c5fd546dea3e45b2f9dd36597/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:30.497099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:30.497099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:30.497099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:30.613375 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] MFA Rules not processed for user `6183320c5fd546dea3e45b2f9dd36597`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:30.619874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:30.659893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 894/1809] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:30.689273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:30.690887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:31.016567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930004-7f13-4d4c-86bb-81b73639c4e2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:31.023075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 916/1810] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:31.169937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:31.171762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:31.213666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:31.223609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:31.224327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:31.226558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:31.226991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:31.373291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187c77-9881-49ab-8ba8-78b5906f1f87 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:31.390953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:31.391897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:31.393176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:31.395216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:31.404521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:31.437059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:31.444340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db6474-be1f-4dd7-aecf-c654b9c5f5c4 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:31.491244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 895/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:31.567263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:31.592494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:31.596724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:31.620117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 917/1812] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:34.624516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78dcb-f22d-4ea9-af96-4f776af41e99 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:34.626725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78dcb-f22d-4ea9-af96-4f776af41e99 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:34.627656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78dcb-f22d-4ea9-af96-4f776af41e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:34.957644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-bbe78dcb-f22d-4ea9-af96-4f776af41e99 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:34.971340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bbe78dcb-f22d-4ea9-af96-4f776af41e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.328761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:35.331062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.360933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777ed-78a2-45b7-9a30-671c846ae278 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:35.364732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 896/1813] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 744 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:35.369759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:35.371393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:35.371836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:35.373119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] PATH_INFO: `/v3/users/f6e6b108e78c47ae9eb6db2287591e78` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:35.379090 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e6b108e78c47ae9eb6db2287591e78)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:35.383734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:35.456343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e6b108e78c47ae9eb6db2287591e78'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.457480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e6b108e78c47ae9eb6db2287591e78'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.478402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e6b108e78c47ae9eb6db2287591e78'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.488834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e6b108e78c47ae9eb6db2287591e78'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.490022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e6b108e78c47ae9eb6db2287591e78'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.549766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 918/1814] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:35 2022] DELETE /identity/v3/users/f6e6b108e78c47ae9eb6db2287591e78 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:35.554714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:35.555115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:35.555730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:35.587456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:35.589662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.595125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:35.598000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.714093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaff3f-78a4-4884-9b6c-fb1d894144a4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:35.743138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:35.743875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:35.744231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:35.744644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:35.752359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.795338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 897/1815] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:35.798923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:35.802505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.824782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768e7f-05c7-4b63-a759-d4840cbc0550 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:35.831405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:35.831981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:35.832267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:35.832697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] PATH_INFO: `/v3/projects/5458e3d65b584309954ed5abcd734958` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:35.835433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5458e3d65b584309954ed5abcd734958)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:35.837420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:35.847804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:35.852073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:35.890586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:35.892962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:35.908292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 919/1816] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:11:35.909934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:35.911711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:35.938301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5458e3d65b584309954ed5abcd734958', 'request_id': 'req-0896b95e-395e-4966-a30a-426084ab6146'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.963488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5458e3d65b584309954ed5abcd734958', 'request_id': 'req-0896b95e-395e-4966-a30a-426084ab6146'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:35.972728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5458e3d65b584309954ed5abcd734958', 'request_id': 'req-0896b95e-395e-4966-a30a-426084ab6146'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.001474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] The token cache is being invalidate because project 5458e3d65b584309954ed5abcd734958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:36.001903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.003701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.013634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 898/1817] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:35 2022] DELETE /identity/v3/projects/5458e3d65b584309954ed5abcd734958 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:36.015301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:36.018233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:36.160307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4505-eabd-4780-a535-32485b03ec15 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:36.431418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b95e-395e-4966-a30a-426084ab6146 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:36.431925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:36.432635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:36.432928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:36.433210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:36.438691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:36.443209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:36.444708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:36.445381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:36.446254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] PATH_INFO: `/v3/users/41ccb62cb04f472cad9506c74588c463` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:36.450934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ccb62cb04f472cad9506c74588c463)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:36.455075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:36.472671 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:36.474249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:36.493868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 920/1818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:36.619748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ccb62cb04f472cad9506c74588c463'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.652046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ccb62cb04f472cad9506c74588c463'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.674195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ccb62cb04f472cad9506c74588c463'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.687643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ccb62cb04f472cad9506c74588c463'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.688868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ccb62cb04f472cad9506c74588c463'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:36.702800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 899/1819] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:36 2022] DELETE /identity/v3/users/41ccb62cb04f472cad9506c74588c463 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:37.361309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:37.365049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:37.385190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d636a-e2aa-4cc4-ad2f-e0468e5d8249 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:37.493839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:37.494942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:37.495848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:37.496132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] PATH_INFO: `/v3/projects/fd4759f018e44b8f9305861b0b4f1a43` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:37.497556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4759f018e44b8f9305861b0b4f1a43)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:37.500310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:37.579776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:37.607997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4759f018e44b8f9305861b0b4f1a43', 'request_id': 'req-af58d770-4b1b-4619-9951-6ddf00d2ae32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.627906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4759f018e44b8f9305861b0b4f1a43', 'request_id': 'req-af58d770-4b1b-4619-9951-6ddf00d2ae32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.646085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4759f018e44b8f9305861b0b4f1a43', 'request_id': 'req-af58d770-4b1b-4619-9951-6ddf00d2ae32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.698789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] The token cache is being invalidate because project fd4759f018e44b8f9305861b0b4f1a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:37.699323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.701793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.718637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 921/1820] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:37 2022] DELETE /identity/v3/projects/fd4759f018e44b8f9305861b0b4f1a43 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:37.722011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:37.723672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:37.743085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1706-b435-476a-aa70-8959d644ec66 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:37.756590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:37.843209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:37.843918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:37.844213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:37.844818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] PATH_INFO: `/v3/users/8b52d5b157aa4b0f8316156758145f21` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:37.846558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b52d5b157aa4b0f8316156758145f21)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:37.848900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:37.932196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b52d5b157aa4b0f8316156758145f21'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.959890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b52d5b157aa4b0f8316156758145f21'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.984006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b52d5b157aa4b0f8316156758145f21'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:37.998317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b52d5b157aa4b0f8316156758145f21'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.001422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b52d5b157aa4b0f8316156758145f21'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.020399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 900/1821] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:37 2022] DELETE /identity/v3/users/8b52d5b157aa4b0f8316156758145f21 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:38.101800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:38.103551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:38.136086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58d770-4b1b-4619-9951-6ddf00d2ae32 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:38.359586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:38.374432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:38.375099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:38.375624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] PATH_INFO: `/v3/projects/560f17f360de4203b9b3a1d02f1e2682` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:38.392991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] RBAC: Authorizing `identity:delete_project(project_id=560f17f360de4203b9b3a1d02f1e2682)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:38.405011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:38.506891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:38.508893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:38.551101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560f17f360de4203b9b3a1d02f1e2682', 'request_id': 'req-61bb1eee-6812-4f11-8663-95eb90ee842f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.560389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560f17f360de4203b9b3a1d02f1e2682', 'request_id': 'req-61bb1eee-6812-4f11-8663-95eb90ee842f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.570729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560f17f360de4203b9b3a1d02f1e2682', 'request_id': 'req-61bb1eee-6812-4f11-8663-95eb90ee842f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.601039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] The token cache is being invalidate because project 560f17f360de4203b9b3a1d02f1e2682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:38.601589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.602541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-61bb1eee-6812-4f11-8663-95eb90ee842f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:38.605452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 922/1822] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:38 2022] DELETE /identity/v3/projects/560f17f360de4203b9b3a1d02f1e2682 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:38.614358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030c56-b53b-4bf0-ab82-1f328f86ed28 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:38.615228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030c56-b53b-4bf0-ab82-1f328f86ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:38.616174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030c56-b53b-4bf0-ab82-1f328f86ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:38.712628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-85030c56-b53b-4bf0-ab82-1f328f86ed28 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:38.715045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-85030c56-b53b-4bf0-ab82-1f328f86ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:38.797353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346abda-8ba8-466b-af37-0c4da3454a5b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:38.962099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 923/1823] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:38.965009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6bb7-cebb-4252-bc3e-9d9db18b2ea1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:38.965524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6bb7-cebb-4252-bc3e-9d9db18b2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:38.966201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6bb7-cebb-4252-bc3e-9d9db18b2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:38.980669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:39.008810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b26d6bb7-cebb-4252-bc3e-9d9db18b2ea1 None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:39.014479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b26d6bb7-cebb-4252-bc3e-9d9db18b2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:39.017113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:39.029398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:39.035876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.038535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.038535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.044311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:39.155519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 924/1824] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 3 12:11:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:39.158645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.158645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.158921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.213532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:39.217007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:39.267169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 925/1825] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:39.269098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:39.276864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:39.337587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:39.340250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:39.345297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941688e-b93e-4e9e-a0cf-727a35b43ccf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:39.371143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:39.373266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.373266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.373266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.415022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 901/1826] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 908 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:39.416859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:39.418617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:39.422306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:39.453264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 926/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:39.460361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:39.467371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:39.489117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad11b-a99e-409a-a7bc-a3e5b5fc7883 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:39.529986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:39.533538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.534026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.534552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.537141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:39.537597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:39.545933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:39.574079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 902/1828] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:39.590336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850222c-3c08-4957-a55f-5e0df24a172c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:39.594075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:39.616123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a26f8-3a99-42fd-9f66-b7e5e1cf2e1f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:39.623833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:39.636316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.637008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.637284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.643697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:39.647583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:39.648401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:39.649117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:39.659587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:39.666259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:39.697758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:39.701263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:39.769328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 927/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:39.821528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 903/1830] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:39.827511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:39.849726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef378f8-de25-421a-a5ee-9e47ac6f3dd6 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:40.090148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:40.095736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:40.273849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:40.288522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:40.291944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:40.294599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:40.318601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:40.339543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:40.429060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48c1a7-a748-4269-bd60-10cd49aeff4a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:40.465651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:40.474354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:40.488356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:40.488646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] PATH_INFO: `/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:40.491164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc39f8a3ca4c4497956b3917b55b7e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:40.500020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 928/1831] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:39 2022] POST /identity/v3/users => generated 293 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:40.505449 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:40.511645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:40.572483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b247d-e8f6-4bd6-a12c-d8659e5daa71 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:40.601410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:40.602568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:40.610729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:40.611794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:40.618486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:40.631871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:40.701690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 929/1832] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:40.707348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:40.756431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc39f8a3ca4c4497956b3917b55b7e', 'request_id': 'req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:40.763349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aace32-fe5f-4023-b8a3-b83ed263a92e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:40.777499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc39f8a3ca4c4497956b3917b55b7e', 'request_id': 'req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:40.796656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc39f8a3ca4c4497956b3917b55b7e', 'request_id': 'req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:40.799167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:40.826388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] The token cache is being invalidate because project 67cc39f8a3ca4c4497956b3917b55b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:40.828259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:40.830789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5519ca8b-b2f8-4c2a-99dc-7e85170a3b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:40.839144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 904/1833] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:40 2022] DELETE /identity/v3/projects/67cc39f8a3ca4c4497956b3917b55b7e => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:40.840821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:40.841127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:40.841470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:40.899079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:40.904319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:41.098722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:41.123045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:41.123772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.124197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.124484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.126071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:41.127171 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ebc37-1dc8-4aa8-8db6-fc48b14f91ec admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:41.160428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 930/1835] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:41.161008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 905/1835] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:41.163212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.163555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.166432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:41.167659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.168588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:41.206557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d033ad-87c1-4d9d-a5ed-c3af3df50172 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:41.222780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:41.226298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:41.230590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:41.236020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.236301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.236673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] PATH_INFO: `/v3/projects/94c90ec46752485d891c6fab96b71650/users/830fa3024c7147baa3481b0af84fcba8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.253618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 931/1836] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:41.259262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:41.287386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30de5-064a-4d36-9294-7319ff6ed841 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:41.303820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:41.305043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.305618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.305985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.312384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:41.312384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:41.312571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c90ec46752485d891c6fab96b71650, user_id=830fa3024c7147baa3481b0af84fcba8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:41.314019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3c52-e723-42c8-84a1-53bd4cfdf303 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:41.326018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:41.355338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 906/1837] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:41 2022] PUT /identity/v3/projects/94c90ec46752485d891c6fab96b71650/users/830fa3024c7147baa3481b0af84fcba8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:41.374385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.375076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.375626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.402890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 932/1838] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:41.411115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:41.527451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] MFA Rules not processed for user `830fa3024c7147baa3481b0af84fcba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:41.528987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:41.536344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59289feb-2118-4810-9279-540515b0eafe admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:41.721759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 907/1839] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:41.728750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:41.846269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213100e6-291b-42fc-ab84-04fcfcfb1ed1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:41.853591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:41.855056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.855370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.855634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.856319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:41.857548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:41.859343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:41.859880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:41.860486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:41.861846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:41.862404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:41.865008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:41.869093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:41.934874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 908/1840] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:41.941595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:41.983484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 933/1841] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:41.983484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.096941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a62ec0-1284-42b0-aa32-f308c9b1502a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.165390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423bd65-6e56-4e9d-97fd-bf8dddd9fc7f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.173562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.174556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.175021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.175731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.176827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.181844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.232450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 934/1842] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:42.236613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.237860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.238493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.238938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.239095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.241402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.246765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.253310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83633ee-0b52-46b1-ae41-5320528ab911 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.259115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.259778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.260064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.260363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.261112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.262848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.285801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 935/1843] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:42.291050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.301418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 909/1844] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:41 2022] POST /identity/v3/users => generated 294 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:42.303180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.321830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2c17-bf74-4554-8024-11f4322e36e2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.326641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349e63c-f028-4960-a59f-c4a6a64c96e3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.336863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.337725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.338082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.338379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.340253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.342201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.343333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.345501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.346236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.346598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.349788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.351564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.360653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 910/1845] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:42.361984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.380261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 936/1846] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:42.382741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.382941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0bb6a-73bb-4b43-94f1-c285bbc5dad1 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.417870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.418556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.418876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.419136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.419871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.421573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.429232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d4a20-c386-4272-8c62-a3441a072696 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.440196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.441054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.441349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.441655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] PATH_INFO: `/v3/projects/3ef17adb9a2a45b4b2f0b8c1299e659e/users/52b8ccb8b8a040d48c40d26d54559f03/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.451847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 911/1847] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:42.459143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.482489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bd9e-adc2-4a0c-938b-d6e3eda59be7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:42.493630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:42.494020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.494356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.494698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] PATH_INFO: `/v3/projects/66e52eb6ee254df6845bf80e5018f8db/users/9bcbcec167e5470f9ba82c1107f30bbe/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.503544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef17adb9a2a45b4b2f0b8c1299e659e, user_id=52b8ccb8b8a040d48c40d26d54559f03, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.506352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b2dc-33bc-4e28-a546-41368288a64e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.521197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e52eb6ee254df6845bf80e5018f8db, user_id=9bcbcec167e5470f9ba82c1107f30bbe, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:42.528336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735cb4-37e8-4a0d-8f3c-6a81203a0446 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:42.534498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 937/1848] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:42 2022] PUT /identity/v3/projects/3ef17adb9a2a45b4b2f0b8c1299e659e/users/52b8ccb8b8a040d48c40d26d54559f03/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:42.546473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78713d-fdde-4890-8f66-ef747c96e162 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.546808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78713d-fdde-4890-8f66-ef747c96e162 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.548561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78713d-fdde-4890-8f66-ef747c96e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.588808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 912/1849] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:42 2022] PUT /identity/v3/projects/66e52eb6ee254df6845bf80e5018f8db/users/9bcbcec167e5470f9ba82c1107f30bbe/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:42.590668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92513f3-7c88-4286-9990-a29d80f9c62d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.590815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:42.594175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92513f3-7c88-4286-9990-a29d80f9c62d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.597262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92513f3-7c88-4286-9990-a29d80f9c62d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.599356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 913/1850] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:11:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:42.600553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.601005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.601456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.671840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2f78713d-fdde-4890-8f66-ef747c96e162 None None] MFA Rules not processed for user `52b8ccb8b8a040d48c40d26d54559f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:42.674286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2f78713d-fdde-4890-8f66-ef747c96e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:42.677270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] MFA Rules not processed for user `9bcbcec167e5470f9ba82c1107f30bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:42.678605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:42.746389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:42.835904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 938/1851] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:42.837363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:42.837767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:42.837924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:42.870237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 914/1852] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:42.870237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:42.871196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:42.871196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:43.031432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fbff7-14fb-4d9a-9bde-e009af31b0af None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.047567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.048249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.048541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.048824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.049529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.051600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.125361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 915/1853] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:42 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:43.129987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.179831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 939/1854] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:43.182202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.217719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66133eb-6b36-4093-8dbd-6c47af3b8673 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.356923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe472a-db1c-4d57-a018-1198065a1fba admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.394480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.396836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.397336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.398204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.415364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.436680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.540593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 916/1855] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:43 2022] POST /identity/v3/projects => generated 387 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:43.542871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.563332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.565840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.566569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.567168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.569163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.573454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.634166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:43.644301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 940/1856] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:43 2022] POST /identity/v3/users => generated 300 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:43.647072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.650019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:43.684929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:43.710807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7845e-ac39-44f2-a313-dc1543b4998c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.733430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.734584 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.735087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.735600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.749029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.759028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.809351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 917/1857] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:43 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:43.811647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.835917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f7271-1952-4302-a1a6-256a483d23c8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.847751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c37a7-4220-4626-b1b5-7579e12b35e4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.848413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.849104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.849418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.849630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.850357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.852041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da659d32-e906-4eec-a016-a3454e84145f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.870983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 918/1858] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:43.873340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab18bf-b8a1-4b55-8ec1-bd35108359d2 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.874266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab18bf-b8a1-4b55-8ec1-bd35108359d2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.874941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab18bf-b8a1-4b55-8ec1-bd35108359d2 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.878304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 919/1859] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:11:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:11:43.880442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab18bf-b8a1-4b55-8ec1-bd35108359d2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.899039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab18bf-b8a1-4b55-8ec1-bd35108359d2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.905373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.906345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.906827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.907171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.907978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.909748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.932996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 920/1860] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:43.932996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:43.943338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ee9d5-dddb-4551-9b61-f5e46cc7b5ba admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:43.949348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.950050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.950829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.951117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] PATH_INFO: `/v3/projects/6060edaf69094e6990850b4641cd3da0/users/2607b9ca5a994b378ed777e97fb0e96b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.965044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:43.965751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.966068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.966422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:43.976811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.978496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb79f-7df8-441d-8994-b5d692afdfdb service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.982567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6060edaf69094e6990850b4641cd3da0, user_id=2607b9ca5a994b378ed777e97fb0e96b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:43.987702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:43.990385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 941/1861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:43.997419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:43.997721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:43.998587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.023980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 921/1862] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:43 2022] PUT /identity/v3/projects/6060edaf69094e6990850b4641cd3da0/users/2607b9ca5a994b378ed777e97fb0e96b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:44.025838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.027552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:44.030183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:44.140445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0cb72-4ba4-4918-a800-c54ecd2e0da6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.147068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.148784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.149265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.149731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] PATH_INFO: `/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9/users/7481c9160d4b44b4a0aeb3e6364e4460/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.153577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 942/1863] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:44.154596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.167422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62887380-d105-43d8-b1cf-1566ba9b3bb9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.176131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.177173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.177466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.177907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.178632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a5bbb7e2574fe78869d6201dd4e7d9, user_id=7481c9160d4b44b4a0aeb3e6364e4460, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.178762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.180401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.184552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.194508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 943/1864] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:44.194508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.209407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 922/1865] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:44 2022] PUT /identity/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9/users/7481c9160d4b44b4a0aeb3e6364e4460/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:44.210630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.218218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f697c-6d8f-4ff7-98cf-7e7e585bb268 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.237267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:44.320036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.321072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.321575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.322095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.365721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.367862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.384160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 944/1866] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:44.385563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.412088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79aa7-d804-410d-92ec-1748b9aa457f service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.422613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85961f6-2d0b-4234-8f21-38000b614783 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.425213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.425879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.427170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.427770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.429227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.433044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.439792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.440431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.440726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.441015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] PATH_INFO: `/v3/projects/6060edaf69094e6990850b4641cd3da0/users/2607b9ca5a994b378ed777e97fb0e96b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.443730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6060edaf69094e6990850b4641cd3da0, user_id=2607b9ca5a994b378ed777e97fb0e96b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.455789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5632ee-3dcd-452d-b561-cdd4de7897e4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.462789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 945/1867] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:44.463170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:44.471141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.480337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 923/1868] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:44 2022] PUT /identity/v3/projects/6060edaf69094e6990850b4641cd3da0/users/2607b9ca5a994b378ed777e97fb0e96b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:44.485634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864995b-a406-49a4-beed-bdbd73dc2721 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:44.499485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.500039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.500679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.534370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] MFA Rules not processed for user `2607b9ca5a994b378ed777e97fb0e96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:44.535993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:44.633306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:44.633306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.633306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.633904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] PATH_INFO: `/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9/users/7481c9160d4b44b4a0aeb3e6364e4460/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.638723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a5bbb7e2574fe78869d6201dd4e7d9, user_id=7481c9160d4b44b4a0aeb3e6364e4460, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:44.656675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fa288-93bd-486e-9555-e377bf733ef4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:44.683030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 946/1869] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:44 2022] PUT /identity/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9/users/7481c9160d4b44b4a0aeb3e6364e4460/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:44.689970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 924/1870] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:44.696642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:44.697141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:44.718683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:44.720165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:44.722413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:44.800724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] MFA Rules not processed for user `7481c9160d4b44b4a0aeb3e6364e4460`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:44.802304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:44.867548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5377-ea1f-4eca-aaa9-3d7f85778c3f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:45.052743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:45.053953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:45.053953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:45.053953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:45.125967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 947/1871] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:45.255793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:45.306020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:45.311800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:45.359675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 925/1872] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:45.417188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:45.436907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:45.443072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:45.446543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37012-3619-4cac-b167-b4b33688758a service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:45.458518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:45.460758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:45.462703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:45.476778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:45.502356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:45.504189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7767262-ed27-4e73-ae93-46e8fba53e91 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:45.536197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 926/1873] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:11:45.630618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b30a8-0cbc-4589-bf95-4647e6433137 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:45.661462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:45.684093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:45.684749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:45.694973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] PATH_INFO: `/v3/users/52b8ccb8b8a040d48c40d26d54559f03` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:45.700323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b8ccb8b8a040d48c40d26d54559f03)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:45.720340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:45.917527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b8ccb8b8a040d48c40d26d54559f03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:45.918574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b8ccb8b8a040d48c40d26d54559f03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:45.973553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b8ccb8b8a040d48c40d26d54559f03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:46.001284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b8ccb8b8a040d48c40d26d54559f03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:46.002563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b8ccb8b8a040d48c40d26d54559f03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:46.029273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 948/1874] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:45 2022] DELETE /identity/v3/users/52b8ccb8b8a040d48c40d26d54559f03 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:46.037254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:46.037844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:46.038153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:46.130249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:46.136972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:46.311848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 927/1875] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:46.550359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:46.552907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:46.839273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088546-e5d0-4a8e-ac46-65a2de924b8f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:46.852492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:46.853720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:46.855019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:46.855481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:46.885282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:46.887132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:46.918813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 949/1876] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:47.634600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:47.638306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:47.950646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3574eb-c692-4cbb-b071-022667aa0d36 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:47.992538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:47.995921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:47.997921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:48.001231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:48.011032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:48.213097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:48.228056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:48.228685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 928/1877] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:11:49.212147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:49.216691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:49.233750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec0c8c-a567-4fdd-a161-60818d521016 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:49.240927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:49.241628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:49.242148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:49.242463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] PATH_INFO: `/v3/projects/3ef17adb9a2a45b4b2f0b8c1299e659e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:49.243850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef17adb9a2a45b4b2f0b8c1299e659e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:49.245918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:49.308538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:49.352144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef17adb9a2a45b4b2f0b8c1299e659e', 'request_id': 'req-522d2140-998a-42aa-94aa-d7cb7a9d31d8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.360147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef17adb9a2a45b4b2f0b8c1299e659e', 'request_id': 'req-522d2140-998a-42aa-94aa-d7cb7a9d31d8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.368599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef17adb9a2a45b4b2f0b8c1299e659e', 'request_id': 'req-522d2140-998a-42aa-94aa-d7cb7a9d31d8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.395031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] The token cache is being invalidate because project 3ef17adb9a2a45b4b2f0b8c1299e659e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:49.395513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.396402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.398472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 950/1878] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:49 2022] DELETE /identity/v3/projects/3ef17adb9a2a45b4b2f0b8c1299e659e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:49.404090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:49.420678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66186-e60d-4f0f-a784-89e7275e9da9 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:49.500064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:49.577450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:49.578131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:49.578420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:49.578742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] PATH_INFO: `/v3/users/2607b9ca5a994b378ed777e97fb0e96b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:49.580164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2607b9ca5a994b378ed777e97fb0e96b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:49.583105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:49.695667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2607b9ca5a994b378ed777e97fb0e96b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.711953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2607b9ca5a994b378ed777e97fb0e96b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.759891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2607b9ca5a994b378ed777e97fb0e96b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.781546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2607b9ca5a994b378ed777e97fb0e96b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.782880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-de5e9e45-119d-4f53-bf29-4883f65e5e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2607b9ca5a994b378ed777e97fb0e96b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:49.796105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 929/1879] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:11:49 2022] DELETE /identity/v3/users/2607b9ca5a994b378ed777e97fb0e96b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:50.941719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:50.943870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:50.965018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2140-998a-42aa-94aa-d7cb7a9d31d8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.029922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.030625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.030917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.031191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] PATH_INFO: `/v3/projects/6060edaf69094e6990850b4641cd3da0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.032395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6060edaf69094e6990850b4641cd3da0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.034312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:51.096743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6060edaf69094e6990850b4641cd3da0', 'request_id': 'req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:51.106050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6060edaf69094e6990850b4641cd3da0', 'request_id': 'req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:51.117186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6060edaf69094e6990850b4641cd3da0', 'request_id': 'req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:51.133458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] The token cache is being invalidate because project 6060edaf69094e6990850b4641cd3da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:11:51.133704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:51.134404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7894e7f4-4c96-491c-bbc7-4f26ee193dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:11:51.136443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 951/1880] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:11:50 2022] DELETE /identity/v3/projects/6060edaf69094e6990850b4641cd3da0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:11:51.142151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.142995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.143086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.164697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:51.165936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:51.243320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 930/1881] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:51.251813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.252203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.252610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.274209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:51.275641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:51.285459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 952/1882] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:51.290643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:51.305987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59731-f395-4895-be6f-a648cc66ef6b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.311937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.312599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.312884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.313163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.313893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:11:51.314264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.315991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:51.334076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 931/1883] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:11:51.339097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:51.374263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b58b-7876-47c8-94a0-f938a8c258da None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.407840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.426909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.427554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.428160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.429162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.431575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:51.501609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 953/1884] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:51 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:11:51.503904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:51.547535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af780b-a3ac-4165-b276-0df32918f15f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.656564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:51.754472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.755353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.755758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.756354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.756955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.764588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:51.810370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 932/1885] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:51 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:51.814820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:51.830738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe7fdc-1963-4e62-bef4-006c74364176 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.848049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.848796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.849238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.858486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.858486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.858486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:51.900517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 954/1886] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:51.905403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:51.920298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cef4d-1e22-4a12-abcc-3c42daf136e6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:51.938335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:51.939434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:51.939831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:51.940235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:51.941077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:51.959920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae35f-e0eb-40db-98b0-0d28b0624539 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:52.003964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 933/1887] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:52.010265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:52.030211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec072-01f3-425b-98bc-200c42697665 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:52.049000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:52.049812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.050147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.050566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] PATH_INFO: `/v3/projects/e44dd3b162024961bf9e47f103828ccc/users/f6f2e110480940668682bb43df900743/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:52.053483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:52.080903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44dd3b162024961bf9e47f103828ccc, user_id=f6f2e110480940668682bb43df900743, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:52.083968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:52.109551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 955/1888] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:52 2022] PUT /identity/v3/projects/e44dd3b162024961bf9e47f103828ccc/users/f6f2e110480940668682bb43df900743/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:52.120468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.120763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.121099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:52.181261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] MFA Rules not processed for user `f6f2e110480940668682bb43df900743`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:52.182871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:52.288610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 934/1889] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:11:52.294010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:52.488613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a9159-3fb1-45ae-9041-1f3126e496c6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:52.497362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:52.499405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.499814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.500169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:52.501445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:52.504124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:52.552675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 956/1890] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:11:52 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:52.556571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:52.583667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c7ed-0c5e-498f-afce-2caab134af73 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:52.721500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:52.724499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.724874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.725248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:52.726058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:52.728303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:52.798012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 935/1891] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:11:52 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:11:52.801556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:52.840100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e92ee3-ee35-4bc9-8349-bba557049325 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:52.871209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:52.872436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.872963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.873500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:52.878054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:52.882393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:52.925378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 957/1892] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:11:52.931020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:52.962070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c207-8d5f-4018-be1f-5b285c02f93f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:52.970560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:52.973419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:52.973930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:52.974420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] PATH_INFO: `/v3/projects/a4be3fbb80264aa582430094872142e6/users/7dc48a8d8ad44f69a5831a04fceb2573/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:53.032566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4be3fbb80264aa582430094872142e6, user_id=7dc48a8d8ad44f69a5831a04fceb2573, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:53.057051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:53.106351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 936/1893] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:52 2022] PUT /identity/v3/projects/a4be3fbb80264aa582430094872142e6/users/7dc48a8d8ad44f69a5831a04fceb2573/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:53.110566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:53.133658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223af9-3209-4794-bdef-58b0bb61e3a5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:53.351803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:53.356093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:53.360695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:53.362765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:53.363711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:53.367017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29d949-73c6-4afb-a66c-facb9f808123 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:53.405341 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 958/1894] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:11:53.407049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:53.435181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f79f-5f2a-45a8-9b4c-d6b44e4e57b3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:53.469044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:53.473013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:53.473013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:53.473013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] PATH_INFO: `/v3/projects/a4be3fbb80264aa582430094872142e6/users/7dc48a8d8ad44f69a5831a04fceb2573/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:53.480095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4be3fbb80264aa582430094872142e6, user_id=7dc48a8d8ad44f69a5831a04fceb2573, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:53.487307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:53.507438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:53.543101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 937/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:11:53 2022] PUT /identity/v3/projects/a4be3fbb80264aa582430094872142e6/users/7dc48a8d8ad44f69a5831a04fceb2573/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:11:53.559477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:53.560046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:53.560556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:53.608490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] MFA Rules not processed for user `7dc48a8d8ad44f69a5831a04fceb2573`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:11:53.610925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:53.756986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:53.877771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 959/1896] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:11:55.771335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:11:55.773396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:55.856063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467150-15e7-43ca-910c-525aeb57b408 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:11:55.862290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:11:55.863474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:11:55.863994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:11:55.864478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:11:55.867583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:11:55.979521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:11:55.981293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:11:55.993329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 938/1897] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:03.866738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:05.784910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:05.787555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:05.812900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314ec0-4f93-4895-bc9b-4554d7f63ce9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:05.819880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:05.821212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:05.821886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:05.822548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:05.846151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:05.849045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:05.876360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 960/1898] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:05.988023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=50 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:06.672766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:06.691634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b89c9a-0d08-4118-ae6c-8be4c7f76ac0 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:06.702352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc48a8d8ad44f69a5831a04fceb2573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4be3fbb80264aa582430094872142e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:06.704210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:06.705850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:06.706834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:06.708607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:06.710007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:06.715621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:06.738230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 939/1899] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:06.743594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:06.767126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177f52-4fe6-4387-8d93-ceaa9503c307 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:06.779343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc48a8d8ad44f69a5831a04fceb2573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4be3fbb80264aa582430094872142e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:06.781170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:06.781832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:06.782339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:06.783826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:06.787513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:06.842284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 961/1900] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:06 2022] POST /identity/v3/projects => generated 354 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:06.850514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:06.861482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dfe8-4ba1-4dc4-932f-a0cc4cf98167 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:06.943895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc48a8d8ad44f69a5831a04fceb2573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4be3fbb80264aa582430094872142e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:06.944529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:06.944813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:06.945091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:06.945904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:06.946215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:06.948870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:06.962910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 940/1901] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:12:07.007867 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:07.019470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bedd3c-5b82-46c7-8dd4-98814212ff8e tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:07.026539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc48a8d8ad44f69a5831a04fceb2573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4be3fbb80264aa582430094872142e6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:07.027252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:07.027631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:07.027971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] PATH_INFO: `/v3/projects/f1679f0224c44ecdb71e00a3c3237dbc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:07.029277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1679f0224c44ecdb71e00a3c3237dbc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:07.031256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:07.091378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1679f0224c44ecdb71e00a3c3237dbc', 'request_id': 'req-941b64e8-4587-46ef-ba59-18edea85f557'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.097460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1679f0224c44ecdb71e00a3c3237dbc', 'request_id': 'req-941b64e8-4587-46ef-ba59-18edea85f557'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.105459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1679f0224c44ecdb71e00a3c3237dbc', 'request_id': 'req-941b64e8-4587-46ef-ba59-18edea85f557'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.119001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] The token cache is being invalidate because project f1679f0224c44ecdb71e00a3c3237dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:07.119351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.120565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-941b64e8-4587-46ef-ba59-18edea85f557 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.122263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 962/1902] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:07 2022] DELETE /identity/v3/projects/f1679f0224c44ecdb71e00a3c3237dbc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:07.336105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:07.337932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:07.414267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d199-b6e6-4f5a-a5d0-001c3d778e26 tempest-VolumeQuotaClassesTest-1316437592 tempest-VolumeQuotaClassesTest-1316437592-project-admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:07.483227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:07.483958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:07.484274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:07.484584 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] PATH_INFO: `/v3/users/f6f2e110480940668682bb43df900743` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:07.485824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f2e110480940668682bb43df900743)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:07.488069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:07.544205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:07.565959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f2e110480940668682bb43df900743'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.574675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f2e110480940668682bb43df900743'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.599373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f2e110480940668682bb43df900743'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.616186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f2e110480940668682bb43df900743'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.617109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f2e110480940668682bb43df900743'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:07.637914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 941/1903] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:07 2022] DELETE /identity/v3/users/f6f2e110480940668682bb43df900743 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:07.642966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:07.643339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:07.644278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:07.687317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:07.689057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:07.799319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 963/1904] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:07.811616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:07.813308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:07.926570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:07.930042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:07.943647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7089e-18d3-4a6d-9c86-8573dccab06d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:07.949780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:07.950909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:07.951652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:07.953042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:07.956623 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8420-9bd3-4194-ba1c-248946a0577e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:07.966067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:07.967274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:07.968029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:07.968743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] PATH_INFO: `/v3/users/830fa3024c7147baa3481b0af84fcba8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:07.972434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=830fa3024c7147baa3481b0af84fcba8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:07.976345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:07.977330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:07.979293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518adf9-336f-4339-a966-56091d9e3c0a service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:07.996788 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 942/1905] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:08.070050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:08.080257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830fa3024c7147baa3481b0af84fcba8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.082583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830fa3024c7147baa3481b0af84fcba8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.128877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830fa3024c7147baa3481b0af84fcba8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.139245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830fa3024c7147baa3481b0af84fcba8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.140372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830fa3024c7147baa3481b0af84fcba8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.185416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 964/1906] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:07 2022] DELETE /identity/v3/users/830fa3024c7147baa3481b0af84fcba8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:08.192421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:08.192779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:08.193216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:08.215035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:08.216283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:08.294317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 943/1907] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:08.304905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:08.306347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:08.394925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2686588-79c5-4c2e-9e3f-921ec841f71a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:08.398689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:08.399323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:08.399614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:08.399952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:08.409590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:08.411111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:08.421814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 965/1908] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:08.454535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:08.456277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:08.469796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9f41-96a8-4a47-85de-755adfb1cf2f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:08.476798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:08.477479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:08.477764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:08.478058 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] PATH_INFO: `/v3/projects/e44dd3b162024961bf9e47f103828ccc` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:08.480128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44dd3b162024961bf9e47f103828ccc)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:08.482135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:08.536700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:08.548699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44dd3b162024961bf9e47f103828ccc', 'request_id': 'req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.559968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44dd3b162024961bf9e47f103828ccc', 'request_id': 'req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.568844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44dd3b162024961bf9e47f103828ccc', 'request_id': 'req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.581847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] The token cache is being invalidate because project e44dd3b162024961bf9e47f103828ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:08.582235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.583042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.584656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 944/1909] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:08 2022] DELETE /identity/v3/projects/e44dd3b162024961bf9e47f103828ccc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:08.588855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:08.599217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43b6d-09b6-41da-8565-684525b6900c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:08.692681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:08.693383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:08.693667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:08.693955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] PATH_INFO: `/v3/users/7dc48a8d8ad44f69a5831a04fceb2573` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:08.695188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc48a8d8ad44f69a5831a04fceb2573)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:08.697163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:08.749830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc48a8d8ad44f69a5831a04fceb2573'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.750561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc48a8d8ad44f69a5831a04fceb2573'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.760682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:08.763833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:08.768336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc48a8d8ad44f69a5831a04fceb2573'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.770327 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:08.779026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc48a8d8ad44f69a5831a04fceb2573'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.780299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc48a8d8ad44f69a5831a04fceb2573'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.786244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e468c9-32d9-4b5b-973f-11b7ae4bfca3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:08.796100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:08.797174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:08.797646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:08.798117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] PATH_INFO: `/v3/projects/94c90ec46752485d891c6fab96b71650` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:08.800260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c90ec46752485d891c6fab96b71650)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:08.803933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 966/1910] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:08 2022] DELETE /identity/v3/users/7dc48a8d8ad44f69a5831a04fceb2573 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:08.804608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:08.931977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c90ec46752485d891c6fab96b71650', 'request_id': 'req-e009ac58-c25d-485c-b64f-ebabaa6375c2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.950011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c90ec46752485d891c6fab96b71650', 'request_id': 'req-e009ac58-c25d-485c-b64f-ebabaa6375c2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.964360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c90ec46752485d891c6fab96b71650', 'request_id': 'req-e009ac58-c25d-485c-b64f-ebabaa6375c2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.987693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] The token cache is being invalidate because project 94c90ec46752485d891c6fab96b71650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:08.988194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.989043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:08.994541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 945/1911] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:08 2022] DELETE /identity/v3/projects/94c90ec46752485d891c6fab96b71650 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:08.996809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:08.998952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:09.090622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d806-06a2-4199-8b5f-95066bc2e4dd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:09.180693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:09.183283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:09.183283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:09.184417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] PATH_INFO: `/v3/users/9bcbcec167e5470f9ba82c1107f30bbe` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:09.186895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcbcec167e5470f9ba82c1107f30bbe)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:09.190523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:09.308830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcbcec167e5470f9ba82c1107f30bbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.311877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcbcec167e5470f9ba82c1107f30bbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.340870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcbcec167e5470f9ba82c1107f30bbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.391835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcbcec167e5470f9ba82c1107f30bbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.393539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-25941d0b-ae9b-4374-950a-182860349c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcbcec167e5470f9ba82c1107f30bbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.429711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 967/1912] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:08 2022] DELETE /identity/v3/users/9bcbcec167e5470f9ba82c1107f30bbe => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:09.456760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:09.461345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:09.498219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009ac58-c25d-485c-b64f-ebabaa6375c2 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:09.594034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:09.596693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:09.596954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:09.597201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] PATH_INFO: `/v3/projects/a4be3fbb80264aa582430094872142e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:09.599104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4be3fbb80264aa582430094872142e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:09.601045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:09.708524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4be3fbb80264aa582430094872142e6', 'request_id': 'req-c8ed3121-199f-417f-b4ee-260ca20ec6a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.726990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4be3fbb80264aa582430094872142e6', 'request_id': 'req-c8ed3121-199f-417f-b4ee-260ca20ec6a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.730351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:09.739554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4be3fbb80264aa582430094872142e6', 'request_id': 'req-c8ed3121-199f-417f-b4ee-260ca20ec6a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.762671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] The token cache is being invalidate because project a4be3fbb80264aa582430094872142e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:09.763071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.764433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8ed3121-199f-417f-b4ee-260ca20ec6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:09.766524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 946/1913] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:09 2022] DELETE /identity/v3/projects/a4be3fbb80264aa582430094872142e6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:09.772222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:09.772526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:09.772903 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:09.796663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:09.798050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:09.806257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:09.893104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 968/1914] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:09.902836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:09.903264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:09.903461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:09.929484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:09.930840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:09.949737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 947/1915] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:09.956073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:09.973712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b722574-a01f-407c-b4e0-340d8765cda1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:09.980708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:09.981530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:09.981877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:09.982229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:09.983249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:09.983566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:09.985512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:09.989909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:09.992840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:10.005741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 969/1916] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:10.006759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.016687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71185b-092e-4fee-8745-bdd49c29ac7d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.017900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd843-9884-4022-8426-0bdc6ee32b5b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.024383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.025029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.025352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.026153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.027150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.028293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.029115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.029605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.030196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.030810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] PATH_INFO: `/v3/projects/66e52eb6ee254df6845bf80e5018f8db` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.033206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e52eb6ee254df6845bf80e5018f8db)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.037445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.086023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 970/1917] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:10 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:10.089440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.158026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e52eb6ee254df6845bf80e5018f8db', 'request_id': 'req-8c209af3-4690-448b-a556-7dc05b2bffaf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.172096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e52eb6ee254df6845bf80e5018f8db', 'request_id': 'req-8c209af3-4690-448b-a556-7dc05b2bffaf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.185310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e52eb6ee254df6845bf80e5018f8db', 'request_id': 'req-8c209af3-4690-448b-a556-7dc05b2bffaf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.197082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f6e7-676a-4aae-a4d6-2fd627c4223e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.203443 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] The token cache is being invalidate because project 66e52eb6ee254df6845bf80e5018f8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:10.204790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.205794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.208714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 948/1918] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:09 2022] DELETE /identity/v3/projects/66e52eb6ee254df6845bf80e5018f8db => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:10.215425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.219675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:10.309190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.309961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.310320 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.310731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.311512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.314423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.352508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 971/1919] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:10 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:10.357227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.359940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c209af3-4690-448b-a556-7dc05b2bffaf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.360836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:10.365233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.366229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.366696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.367292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] PATH_INFO: `/v3/users/7481c9160d4b44b4a0aeb3e6364e4460` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.368806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7481c9160d4b44b4a0aeb3e6364e4460)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.371582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.377639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749b05-2712-47aa-9c4f-79a4d37a6d4c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.403360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.403360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.403360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.403360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.403984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.408627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.425348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:10.443059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 972/1920] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:10.443886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.471174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5cecb-e8b9-4b7f-89a6-47329a149df5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.487133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.487952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.488252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.488527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.489271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.491913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.518486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7481c9160d4b44b4a0aeb3e6364e4460'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.531059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7481c9160d4b44b4a0aeb3e6364e4460'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.543018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:10.564720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7481c9160d4b44b4a0aeb3e6364e4460'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.570393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 973/1921] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:10.578533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.602304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030a31-2598-4600-9c9c-7a844a63ec83 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:10.604882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7481c9160d4b44b4a0aeb3e6364e4460'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.605720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-89617bde-556d-4b98-aba1-28792e102176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7481c9160d4b44b4a0aeb3e6364e4460'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:10.608322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:10.609032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.609317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.609602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] PATH_INFO: `/v3/projects/b368dcba9bd94e1bbb48aae4497eada7/users/5fbafae69d8647cf97ce0f5ec68bf0dd/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.624718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 949/1922] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:10 2022] DELETE /identity/v3/users/7481c9160d4b44b4a0aeb3e6364e4460 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:10.662263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b368dcba9bd94e1bbb48aae4497eada7, user_id=5fbafae69d8647cf97ce0f5ec68bf0dd, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:10.665029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:10.703307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 974/1923] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:10 2022] PUT /identity/v3/projects/b368dcba9bd94e1bbb48aae4497eada7/users/5fbafae69d8647cf97ce0f5ec68bf0dd/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:10.715427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:10.715734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:10.715997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:10.768394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] MFA Rules not processed for user `5fbafae69d8647cf97ce0f5ec68bf0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:10.769661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:10.912615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:10.916113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:10.927573 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 950/1924] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:11.087051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2515-241e-4aaf-a78f-a70a80d99a1c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.094411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.095146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.095435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.095778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.096431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.098365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.134384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 975/1925] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:10 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:11.139288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.152757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15129c-edb4-46a8-bf86-70cfd033136c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.191115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.193157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.223375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.223927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.224293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.224527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.225250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.227622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.253541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 951/1926] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:11.258925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.270753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4fc4-2f1b-475b-95a3-829189025edf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.275479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.276110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.276400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.276689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.278014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.279697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.289977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 952/1927] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:11.294857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.295545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926646-91dc-48aa-8447-21239614b2c4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.300959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.301600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.301881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.302172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] PATH_INFO: `/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.303393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a5bbb7e2574fe78869d6201dd4e7d9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.305316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.312457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8990447-41b5-44e0-bf4a-facf84c75211 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.321544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.323245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.323731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.324249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] PATH_INFO: `/v3/projects/1e4b7b2f823f493892e33aeafe707c20/users/f06261f795384e71b9c4dbdfbb59b9c6/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.348772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4b7b2f823f493892e33aeafe707c20, user_id=f06261f795384e71b9c4dbdfbb59b9c6, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.351790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.364665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a5bbb7e2574fe78869d6201dd4e7d9', 'request_id': 'req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:11.367728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:11.369006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 953/1928] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:11 2022] PUT /identity/v3/projects/1e4b7b2f823f493892e33aeafe707c20/users/f06261f795384e71b9c4dbdfbb59b9c6/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:11.374004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.375492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a5bbb7e2574fe78869d6201dd4e7d9', 'request_id': 'req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:11.386870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a5bbb7e2574fe78869d6201dd4e7d9', 'request_id': 'req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:11.404646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] The token cache is being invalidate because project b7a5bbb7e2574fe78869d6201dd4e7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:11.405049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:11.405904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-71b361ac-8b7a-4ecc-80a7-dd2368f4e5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:11.408177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 976/1929] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:11 2022] DELETE /identity/v3/projects/b7a5bbb7e2574fe78869d6201dd4e7d9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:11.412758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:11.414929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e852e-0184-4e38-bce7-071fa8dbb0e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.415373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e852e-0184-4e38-bce7-071fa8dbb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.415797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e852e-0184-4e38-bce7-071fa8dbb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.441656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-057e852e-0184-4e38-bce7-071fa8dbb0e8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:11.442937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-057e852e-0184-4e38-bce7-071fa8dbb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.463426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f884a-e950-4285-bd8d-aef289c4ac5e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.469046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.469691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.470176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.470494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.471692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.473602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.497274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 954/1930] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:11.503487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.505974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.524656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533341-45e9-4b91-b76a-856a115465d6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.531853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.533012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.533300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.534353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] PATH_INFO: `/v3/projects/1e4b7b2f823f493892e33aeafe707c20/users/f06261f795384e71b9c4dbdfbb59b9c6/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.537973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4b7b2f823f493892e33aeafe707c20, user_id=f06261f795384e71b9c4dbdfbb59b9c6, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.542213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d549cc-3592-4c00-a093-f724832d3dc3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.557438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 955/1931] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:11 2022] PUT /identity/v3/projects/1e4b7b2f823f493892e33aeafe707c20/users/f06261f795384e71b9c4dbdfbb59b9c6/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:11.566360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 977/1932] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:11.568695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145533c9-f605-4624-ab70-dc312a368e82 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.569957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145533c9-f605-4624-ab70-dc312a368e82 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.569957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145533c9-f605-4624-ab70-dc312a368e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.573898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.574460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.575144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.592053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-145533c9-f605-4624-ab70-dc312a368e82 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:11.593311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-145533c9-f605-4624-ab70-dc312a368e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.625581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] MFA Rules not processed for user `f06261f795384e71b9c4dbdfbb59b9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:11.626887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.698341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 956/1933] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:11.703364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17a5-6a1e-49e2-8b22-cd68faa444e0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.703842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17a5-6a1e-49e2-8b22-cd68faa444e0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.704189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17a5-6a1e-49e2-8b22-cd68faa444e0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.705620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 957/1934] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:12:11.706605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd17a5-6a1e-49e2-8b22-cd68faa444e0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.722160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd17a5-6a1e-49e2-8b22-cd68faa444e0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.728331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.729519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.729834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.730092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.732746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:11.733090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.735202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1479c-0416-4526-bb7a-901a9c3b5ace admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.759424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 958/1935] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:11.761290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.761614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.761890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.797198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 978/1936] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:11.801577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.834748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:11.837091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:11.858585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a2123-d6fc-4b5e-8c34-20c6d116139b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:11.881688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:11.882895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:11.883198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:11.883485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:11.884172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:11.898828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:11.941336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 979/1937] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:11.942548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:11.945263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:12.012052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:12.030897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17020cfc-d0ba-4dcf-ab92-cbe0c7405ce6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.035893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.036728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.037103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.037477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.072522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 959/1938] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:12.073191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.100181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40b28c-d408-4a99-bbc9-f73b528a9473 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.153339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.156901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.174602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:12.175800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 980/1939] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:12.262748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.263391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.263683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.263967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.264758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.266837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.316737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 960/1940] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:12 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:12.321836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.355472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320757b-f626-4405-b961-d3320f8bc697 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.360113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.364738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.365694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.366130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.366593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.367935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.370916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.378118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34bd1f-7228-4f49-b152-e7b5e9f13c94 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.386100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 981/1941] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:12.387120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.387844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.388163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.388277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.388602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.390319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:12.395214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:12.491962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.495903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.510294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 961/1942] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:12.511308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.524019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae8a0-71c8-4ac3-ade2-780c72e0548f service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.533183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.534016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.534694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.535367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.536360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.542172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.555781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500e5e0-9cc4-4473-8aa4-95c6cc3838b1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.570154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 962/1943] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:12.574708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.575138 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:12.579203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.580900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.581834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.588880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4fb2a-ca2f-4afc-b3a3-9818d95e6166 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:12.601120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:12.601890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.602231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.602561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] PATH_INFO: `/v3/projects/890cbb2fadce4b6d9224b44d04859fe5/users/d43c107ff74d491db081fe5c9c39c9a2/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.617091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.622115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43f5d-8ecb-4332-819e-0de900f4a8a9 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.628728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890cbb2fadce4b6d9224b44d04859fe5, user_id=d43c107ff74d491db081fe5c9c39c9a2, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:12.641245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:12.653365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 982/1944] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:12.659063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 963/1945] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:12 2022] PUT /identity/v3/projects/890cbb2fadce4b6d9224b44d04859fe5/users/d43c107ff74d491db081fe5c9c39c9a2/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:12.680797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:12.681333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:12.682478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:12.765541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] MFA Rules not processed for user `d43c107ff74d491db081fe5c9c39c9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:12.767296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:12.888612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:12.900113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 983/1946] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:12.905601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.044761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35c1b-7975-49db-bb9e-694d565c1fb7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.061815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.062752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.063052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.063334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.064028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.066178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.122265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 964/1947] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:12 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:13.126545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.151101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d75ff0-d1fe-4d3a-99d8-864a150d532c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.264934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.266415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.267429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.268124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.269716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.273277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.310512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 984/1948] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:13 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:13.315581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.333704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698318-170a-4e66-8c25-80f8cb656900 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.341450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.342108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.342394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.342819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.343491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.345501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.347191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:13.366711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 965/1949] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:13.367823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.380486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2180-b740-4253-b160-78b834a2e100 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.400857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.402259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.402502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.402786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] PATH_INFO: `/v3/projects/583bae21b20c4013a76306f17bf5074b/users/aa3ce72a093c43dcb277c2273199ed36/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.429442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=583bae21b20c4013a76306f17bf5074b, user_id=aa3ce72a093c43dcb277c2273199ed36, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.433272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.456609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 985/1950] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:13 2022] PUT /identity/v3/projects/583bae21b20c4013a76306f17bf5074b/users/aa3ce72a093c43dcb277c2273199ed36/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:13.461478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.475889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a819-ad5b-4482-8fd8-a6c6aa1a292b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.615695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.616362 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.616673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.616958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.617673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.619445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a2ee-4495-4c6e-969a-b5dd37e226bc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.631305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 966/1951] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:13.636025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.650029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffaf2d-6b2a-47cb-886a-13b2f9596d2c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.657220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.657919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.658526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.658949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] PATH_INFO: `/v3/projects/583bae21b20c4013a76306f17bf5074b/users/aa3ce72a093c43dcb277c2273199ed36/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.661233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583bae21b20c4013a76306f17bf5074b, user_id=aa3ce72a093c43dcb277c2273199ed36, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.664079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.680436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 986/1952] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:13 2022] PUT /identity/v3/projects/583bae21b20c4013a76306f17bf5074b/users/aa3ce72a093c43dcb277c2273199ed36/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:13.691278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.691677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.691866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.727704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] MFA Rules not processed for user `aa3ce72a093c43dcb277c2273199ed36`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:13.729649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:13.829895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 967/1953] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:13.845753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:13.847912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:13.923274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863c39-a7c4-4ab2-8c9d-227d4a3f0dd1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:13.927331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:13.927984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:13.928267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:13.928548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:13.942379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:13.944912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce836a1-5abf-4acc-a2e2-2ec6a6a2f26a service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:13.959687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 987/1954] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:14.962397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:15.052400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7937a-411a-462c-b53c-b6be64e6b8ea None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:15.059462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:15.060141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:15.060427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:15.060709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] PATH_INFO: `/v3/users/d43c107ff74d491db081fe5c9c39c9a2` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:15.061935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43c107ff74d491db081fe5c9c39c9a2)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:15.063963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:15.087534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:15.124451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43c107ff74d491db081fe5c9c39c9a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.137713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43c107ff74d491db081fe5c9c39c9a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.150907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43c107ff74d491db081fe5c9c39c9a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.163160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43c107ff74d491db081fe5c9c39c9a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.164257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43c107ff74d491db081fe5c9c39c9a2'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.175808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 968/1955] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:14 2022] DELETE /identity/v3/users/d43c107ff74d491db081fe5c9c39c9a2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:15.182735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:15.183237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:15.183409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:15.205169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:15.206399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:15.267886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:15.285209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 988/1956] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:15.296608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:15.298150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:15.371571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16d9c-8aac-44f1-b39c-008826f122c1 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:15.375299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:15.375927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:15.376214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:15.376490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:15.386171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:15.387899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:15.398127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 969/1957] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:15.685175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:15.686943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:15.705482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51aa4-652f-45e2-b0df-9550cbdb6009 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:15.710389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:15.711189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:15.711539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:15.711909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] PATH_INFO: `/v3/projects/890cbb2fadce4b6d9224b44d04859fe5` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:15.713188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890cbb2fadce4b6d9224b44d04859fe5)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:15.715277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:15.773111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890cbb2fadce4b6d9224b44d04859fe5', 'request_id': 'req-de701b7c-811f-45b0-aaed-dddba8d1cb12'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.778907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890cbb2fadce4b6d9224b44d04859fe5', 'request_id': 'req-de701b7c-811f-45b0-aaed-dddba8d1cb12'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.785482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890cbb2fadce4b6d9224b44d04859fe5', 'request_id': 'req-de701b7c-811f-45b0-aaed-dddba8d1cb12'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.798947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] The token cache is being invalidate because project 890cbb2fadce4b6d9224b44d04859fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:15.799236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.799869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.801407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 989/1958] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:15 2022] DELETE /identity/v3/projects/890cbb2fadce4b6d9224b44d04859fe5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:15.805723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:15.816961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7377444-8ea4-49ac-8652-5e0dc1e8363d service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:15.880566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:15.881235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:15.881520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:15.881811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] PATH_INFO: `/v3/users/aa3ce72a093c43dcb277c2273199ed36` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:15.883093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3ce72a093c43dcb277c2273199ed36)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:15.885803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:15.957767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:15.960651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3ce72a093c43dcb277c2273199ed36'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.973628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3ce72a093c43dcb277c2273199ed36'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.989587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3ce72a093c43dcb277c2273199ed36'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:15.999913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3ce72a093c43dcb277c2273199ed36'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.000953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a5ad211f-5382-421f-b38b-047928bbaa02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3ce72a093c43dcb277c2273199ed36'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.014114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 970/1959] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:15 2022] DELETE /identity/v3/users/aa3ce72a093c43dcb277c2273199ed36 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:16.455852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:16.457428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:16.483586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de701b7c-811f-45b0-aaed-dddba8d1cb12 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:16.566225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:16.566932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:16.567226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:16.567534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] PATH_INFO: `/v3/projects/583bae21b20c4013a76306f17bf5074b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:16.569033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583bae21b20c4013a76306f17bf5074b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:16.571098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:16.623059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583bae21b20c4013a76306f17bf5074b', 'request_id': 'req-300526de-70af-4353-b325-dc2c4be46ae2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.629537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583bae21b20c4013a76306f17bf5074b', 'request_id': 'req-300526de-70af-4353-b325-dc2c4be46ae2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.637120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583bae21b20c4013a76306f17bf5074b', 'request_id': 'req-300526de-70af-4353-b325-dc2c4be46ae2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.650023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] The token cache is being invalidate because project 583bae21b20c4013a76306f17bf5074b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:16.650367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.651054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-300526de-70af-4353-b325-dc2c4be46ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:16.652656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 990/1960] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:16 2022] DELETE /identity/v3/projects/583bae21b20c4013a76306f17bf5074b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:16.657692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:16.657989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:16.658302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:16.678813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:16.680168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:16.759182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 971/1961] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:16.767920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:16.768211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:16.768486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:16.783670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:16.789718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:16.792365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:16.803546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 991/1962] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:16.808768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:16.820791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54741-5dcb-4c00-b267-5fde175983d1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:16.825876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:16.826547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:16.826883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:16.827301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:16.828131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:16.828543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:16.830425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:16.845642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 972/1963] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:16.850484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:16.866722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62f5c-9a27-4faa-bdaf-385a7c0c1887 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:16.872572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:16.873226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:16.873513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:16.873809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:16.874549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:16.876536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:16.912241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 992/1964] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:16 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:16.920509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:16.933781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644f17-ad89-4bbb-8afa-d2b3a3832195 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.004203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.004970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.005262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.005572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.006429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.008769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.033710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 973/1965] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:16 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:17.037996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.051318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18daf-2082-4101-a560-b670b5071f63 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.058135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.058880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.059213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.059536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.060303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.062278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.074654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 993/1966] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:17.079397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.090140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a9c9-ae59-4ee4-ad99-116f30b38a6b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.095887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.096668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.097002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.097332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.098171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.099966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6c201-cdf5-413b-9ebd-1cde11fe4b25 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.112914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 974/1967] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:17.117673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.129154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee3fa-d901-4e61-9da3-a2b9accb244a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.133909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.134666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.134961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.135246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] PATH_INFO: `/v3/projects/ec9eab34627e4210b34f9a5703ee5c33/users/41d50a74347d49fd88825effe6b93c5a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.153793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9eab34627e4210b34f9a5703ee5c33, user_id=41d50a74347d49fd88825effe6b93c5a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.156568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.179078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 994/1968] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:17 2022] PUT /identity/v3/projects/ec9eab34627e4210b34f9a5703ee5c33/users/41d50a74347d49fd88825effe6b93c5a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:17.199316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.200170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.200780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.263490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] MFA Rules not processed for user `41d50a74347d49fd88825effe6b93c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:17.266297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:17.296459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:17.448489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 975/1969] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:17.452895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.727001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8d690-c284-483c-8f7e-73d0eeefa662 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.763256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.763917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.764687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.764687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.765212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.774017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.787038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.788453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:17.816197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe82d8-a917-42b7-9d91-0eca37330990 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.827448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.829210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.829904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.830177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 995/1970] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:17 2022] POST /identity/v3/projects => generated 375 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:17.831205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] PATH_INFO: `/v3/users/93afce32e4854c87929a419210fc4cb6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.832900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:17.833903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93afce32e4854c87929a419210fc4cb6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.842432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:17.925063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93afce32e4854c87929a419210fc4cb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:17.945508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93afce32e4854c87929a419210fc4cb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:17.974521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715003-e143-4c54-8df0-95d9c6a07eda admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:17.982794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93afce32e4854c87929a419210fc4cb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:17.984790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:17.985838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:17.986242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:17.987015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:17.988125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:17.992164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.003508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93afce32e4854c87929a419210fc4cb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:18.004705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-3a31e234-0871-427f-9e53-45d0f038416c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93afce32e4854c87929a419210fc4cb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:18.024116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 976/1971] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:17 2022] DELETE /identity/v3/users/93afce32e4854c87929a419210fc4cb6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:18.034616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.035273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.035827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.051597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 996/1972] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:17 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:18.055966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.060050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:18.093328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1da562-5d7e-4338-b1c9-56ab569ae2ff admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:18.104300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:18.106381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:18.126955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:18.263508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:18.265683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.266388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.280235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.281705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:18.284855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.308180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 977/1973] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:18.308790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 997/1974] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:18.313330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.319351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.322252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:18.332479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2aff-a672-4778-9020-b8a572265690 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:18.339104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:18.340330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.340955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.342351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] PATH_INFO: `/v3/projects/2d75d448906440628119120878c91194/users/00252657028649dc8d56ab28c570e0ba/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.373754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d75d448906440628119120878c91194, user_id=00252657028649dc8d56ab28c570e0ba, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:18.378338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.406621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 978/1975] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:18 2022] PUT /identity/v3/projects/2d75d448906440628119120878c91194/users/00252657028649dc8d56ab28c570e0ba/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:18.413565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.422875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:18.466856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c133b6-f523-46c6-9e14-3158fdea71f4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:18.539506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7cd4-6a0a-4f04-bd09-386964d5a06f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:18.553575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:18.555731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.558958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.559742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.561500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:18.563875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.585049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 979/1976] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:18.586318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.591510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:18.592715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.593229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.593864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.602383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef84dd-30be-4b06-b217-64e7c7507322 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:18.616017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:18.617173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.617898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.618531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] PATH_INFO: `/v3/projects/2d75d448906440628119120878c91194/users/00252657028649dc8d56ab28c570e0ba/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.623772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d75d448906440628119120878c91194, user_id=00252657028649dc8d56ab28c570e0ba, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:18.629724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.634646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:18.637717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeacee-85e6-4413-9b70-f13183c60411 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:18.656550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 998/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:18.656829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 980/1978] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:18 2022] PUT /identity/v3/projects/2d75d448906440628119120878c91194/users/00252657028649dc8d56ab28c570e0ba/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:18.669114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:18.669709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:18.670202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:18.713860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] MFA Rules not processed for user `00252657028649dc8d56ab28c570e0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:18.715384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:18.855574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:18.866654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 999/1979] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:18.881364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.884060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:18.987847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:18.990513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:19.006601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b0b67-b5f7-4a3f-8a68-0285afd9db43 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:19.013289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:19.014085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:19.014381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:19.014784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:19.016966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:19.105003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7c98-e92b-466f-9afc-a4f794d81c01 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:19.113927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:19.115202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:19.115974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:19.116723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] PATH_INFO: `/v3/users/5fbafae69d8647cf97ce0f5ec68bf0dd` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:19.120193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbafae69d8647cf97ce0f5ec68bf0dd)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:19.125912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:19.127988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:19.132615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da302b-9ada-4807-9b6a-4ad63fbeb0bf service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:19.153312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 981/1980] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:19.225572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbafae69d8647cf97ce0f5ec68bf0dd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:19.226776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbafae69d8647cf97ce0f5ec68bf0dd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:19.261404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbafae69d8647cf97ce0f5ec68bf0dd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:19.293710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbafae69d8647cf97ce0f5ec68bf0dd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:19.294555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbafae69d8647cf97ce0f5ec68bf0dd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:19.326182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1000/1981] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:18 2022] DELETE /identity/v3/users/5fbafae69d8647cf97ce0f5ec68bf0dd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:19.328321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:19.328321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:19.328612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:19.374206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:19.375723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:19.475905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:19.499551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:19.502206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:19.553975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 982/1982] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:19.578895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:19.581997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:19.786017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123f7c-8834-4750-a79a-aff488102624 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:19.798766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:19.800970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:19.801479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:19.802465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] PATH_INFO: `/v3/projects/2c84b25662454652b1a25919dec84481` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:19.804908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c84b25662454652b1a25919dec84481)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:19.809787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:19.878099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2380-766a-418d-8af6-4681a14a2e16 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:19.887518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:19.888832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:19.889647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:19.890214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:19.914999 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:19.919864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:19.937366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:19.957004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 983/1983] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:20.111037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c84b25662454652b1a25919dec84481', 'request_id': 'req-96d5fc11-219a-42ea-a283-e8502bf0f2aa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.125939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c84b25662454652b1a25919dec84481', 'request_id': 'req-96d5fc11-219a-42ea-a283-e8502bf0f2aa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.172270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c84b25662454652b1a25919dec84481', 'request_id': 'req-96d5fc11-219a-42ea-a283-e8502bf0f2aa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.242479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] The token cache is being invalidate because project 2c84b25662454652b1a25919dec84481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:20.242479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.243080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.253086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1001/1984] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:19 2022] DELETE /identity/v3/projects/2c84b25662454652b1a25919dec84481 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:20.255227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:20.287497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e70c4a-849e-49bc-a430-c504c847e1c0 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:20.504858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:20.509104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:20.509457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:20.511836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] PATH_INFO: `/v3/users/6183320c5fd546dea3e45b2f9dd36597` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:20.515830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6183320c5fd546dea3e45b2f9dd36597)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:20.520782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:20.734644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6183320c5fd546dea3e45b2f9dd36597'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.775516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6183320c5fd546dea3e45b2f9dd36597'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.818935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:20.823884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:20.863870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6183320c5fd546dea3e45b2f9dd36597'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.879063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5fc11-219a-42ea-a283-e8502bf0f2aa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:20.900753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:20.903192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6183320c5fd546dea3e45b2f9dd36597'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.903384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:20.904255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:20.904899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] PATH_INFO: `/v3/projects/b368dcba9bd94e1bbb48aae4497eada7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:20.905019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6183320c5fd546dea3e45b2f9dd36597'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:20.908542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b368dcba9bd94e1bbb48aae4497eada7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:20.914613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:20.925431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 984/1985] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:20 2022] DELETE /identity/v3/users/6183320c5fd546dea3e45b2f9dd36597 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:21.102978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b368dcba9bd94e1bbb48aae4497eada7', 'request_id': 'req-dde33c84-673b-4f05-99b8-f8456125e269'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.111774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b368dcba9bd94e1bbb48aae4497eada7', 'request_id': 'req-dde33c84-673b-4f05-99b8-f8456125e269'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.121263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b368dcba9bd94e1bbb48aae4497eada7', 'request_id': 'req-dde33c84-673b-4f05-99b8-f8456125e269'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.170735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] The token cache is being invalidate because project b368dcba9bd94e1bbb48aae4497eada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:21.171526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.173361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.181304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1002/1986] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:20 2022] DELETE /identity/v3/projects/b368dcba9bd94e1bbb48aae4497eada7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:21.182483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:21.184596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:21.196124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:21.367017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feb728-6357-4e87-a0f8-bc7e99c96f9c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:21.503525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:21.505015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:21.505913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:21.506131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] PATH_INFO: `/v3/users/f06261f795384e71b9c4dbdfbb59b9c6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:21.518654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06261f795384e71b9c4dbdfbb59b9c6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:21.528351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:21.608812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:21.610490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:21.637795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde33c84-673b-4f05-99b8-f8456125e269 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:21.656342 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:21.657527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:21.658050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:21.658556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] PATH_INFO: `/v3/projects/d87f95fa8b9847ee970761ec8298f34d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:21.660982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87f95fa8b9847ee970761ec8298f34d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:21.670909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:21.682117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06261f795384e71b9c4dbdfbb59b9c6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.700185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06261f795384e71b9c4dbdfbb59b9c6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.722296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06261f795384e71b9c4dbdfbb59b9c6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.736971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06261f795384e71b9c4dbdfbb59b9c6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.737665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06261f795384e71b9c4dbdfbb59b9c6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.762928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 985/1987] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:21 2022] DELETE /identity/v3/users/f06261f795384e71b9c4dbdfbb59b9c6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:21.803040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87f95fa8b9847ee970761ec8298f34d', 'request_id': 'req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.835580 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87f95fa8b9847ee970761ec8298f34d', 'request_id': 'req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.846989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87f95fa8b9847ee970761ec8298f34d', 'request_id': 'req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.869723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:21.871624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:21.905125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] The token cache is being invalidate because project d87f95fa8b9847ee970761ec8298f34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:21.905451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.912352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fd3bdf1-80b6-47ac-a3d3-76819c67f01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:21.927283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1003/1988] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:21 2022] DELETE /identity/v3/projects/d87f95fa8b9847ee970761ec8298f34d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:21.932992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6132-388f-41e1-9103-2e166faeb188 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:21.934524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6132-388f-41e1-9103-2e166faeb188 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:21.935724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e6132-388f-41e1-9103-2e166faeb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:21.979511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:21.984170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-086e6132-388f-41e1-9103-2e166faeb188 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:21.985322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-086e6132-388f-41e1-9103-2e166faeb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.027002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:22.055892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341752-0884-43ce-a3c2-82764e1d0592 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.147463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:22.148520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.149010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.149604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] PATH_INFO: `/v3/users/5cb1ab2bc0b04fad855f7e4948b38326` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.151880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb1ab2bc0b04fad855f7e4948b38326)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:22.154754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:22.171702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1004/1989] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:22.174387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.174940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.175560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.250007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:22.253995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.297885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb1ab2bc0b04fad855f7e4948b38326'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.305478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1005/1990] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:22.307217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.308492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb1ab2bc0b04fad855f7e4948b38326'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.337227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4fb3-da3c-464c-a887-517987527aff None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.337405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb1ab2bc0b04fad855f7e4948b38326'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.356377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb1ab2bc0b04fad855f7e4948b38326'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.365935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:22.366247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-edb3bf48-3625-4944-a750-233209b3d321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb1ab2bc0b04fad855f7e4948b38326'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.368757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.369364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.370774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.371895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:22.372636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:22.375599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:22.388177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 986/1991] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:21 2022] DELETE /identity/v3/users/5cb1ab2bc0b04fad855f7e4948b38326 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:22.398921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.399202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.399493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.408708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1006/1992] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:22.409773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.412643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.429356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463fa-cd8f-47b2-983e-b7a4ba089dc8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.460056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:22.462277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.542645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:22.546849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.547389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.547747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.549225 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:22.554605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:22.585002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:22.614257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1007/1993] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:22 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:22.615940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.618734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.622615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 987/1994] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:22.622615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.635456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ed76-83c7-48fe-a7f6-5c07f2e43dfc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.713152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:22.713944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.714316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.714822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.715974 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:22.719528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:22.750426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 988/1995] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:22 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:22.751384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.754973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5717169-7446-4ee8-b115-749b5896ac80 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.757078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:22.764107 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:22.765265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:22.765778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:22.766295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] PATH_INFO: `/v3/projects/1e4b7b2f823f493892e33aeafe707c20` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:22.769474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4b7b2f823f493892e33aeafe707c20)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:22.774222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:22.824904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:22.877317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4b7b2f823f493892e33aeafe707c20', 'request_id': 'req-aa9518e7-68be-479e-b975-a0055269d775'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.886604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4b7b2f823f493892e33aeafe707c20', 'request_id': 'req-aa9518e7-68be-479e-b975-a0055269d775'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.895000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4b7b2f823f493892e33aeafe707c20', 'request_id': 'req-aa9518e7-68be-479e-b975-a0055269d775'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.951981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] The token cache is being invalidate because project 1e4b7b2f823f493892e33aeafe707c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:22.954452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.955847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:22.960350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1008/1996] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:22 2022] DELETE /identity/v3/projects/1e4b7b2f823f493892e33aeafe707c20 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:22.961787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:22.963243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076a3e-cedf-4f2b-9b09-a26b79c16b03 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:22.967403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.114862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.115960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.116811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.117505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.122866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.162840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9518e7-68be-479e-b975-a0055269d775 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.178603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.179543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.179760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.180084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.181122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.183040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba9a8-e29c-44ca-96bc-8452bb9e8afa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.195759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1009/1997] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:23.198265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.198788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.199143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.251047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:23.253942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.285794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1010/1998] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:23.290017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:23.293919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.333247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:23.341074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1b61d-649f-4302-ad58-82e101a490d9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.364339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.365525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.366093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.366659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] PATH_INFO: `/v3/users/41d50a74347d49fd88825effe6b93c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.368933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d50a74347d49fd88825effe6b93c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.373169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.385924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.388135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.408256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 989/1999] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:23.409276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:23.440988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967cb80-49b3-4277-b52c-7ed58bbd4363 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.464921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.466039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.466662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.467243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.469387 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.473481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895996f-5a88-4bf4-b738-ddc0d9f0220c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.492222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d50a74347d49fd88825effe6b93c5a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:23.495526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d50a74347d49fd88825effe6b93c5a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:23.507066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 990/2000] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:23.510370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db917-3605-4127-b960-95b7e34d1121 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.511156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db917-3605-4127-b960-95b7e34d1121 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.511931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db917-3605-4127-b960-95b7e34d1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.533921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d50a74347d49fd88825effe6b93c5a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:23.567284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-674db917-3605-4127-b960-95b7e34d1121 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:23.567740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d50a74347d49fd88825effe6b93c5a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:23.568649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d50a74347d49fd88825effe6b93c5a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:23.569641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-674db917-3605-4127-b960-95b7e34d1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.586781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 991/2001] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:23.588825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db917-3605-4127-b960-95b7e34d1121 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:23.594690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1011/2002] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:23 2022] DELETE /identity/v3/users/41d50a74347d49fd88825effe6b93c5a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:23.595293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:23.597506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-674db917-3605-4127-b960-95b7e34d1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:23.617016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db917-3605-4127-b960-95b7e34d1121 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.647941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:23.765750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.768042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.768395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.768911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] PATH_INFO: `/v3/projects/590d91626f9e460a810ce97fc031b057/users/067a03b4e2d6440dbbb950c2bfe90948/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.809450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81efb9-7471-4fd3-8b89-d12eb1bcb8a6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.815302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] RBAC: Authorizing `identity:create_grant(project_id=590d91626f9e460a810ce97fc031b057, user_id=067a03b4e2d6440dbbb950c2bfe90948, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.819383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:23.820631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.821119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.821636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.825336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:23.826041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:23.829317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841797e-ef94-4b5e-913d-b79499e0082f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.829700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:23.858906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 992/2003] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:23 2022] PUT /identity/v3/projects/590d91626f9e460a810ce97fc031b057/users/067a03b4e2d6440dbbb950c2bfe90948/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:23.861096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4fc60-ecc7-4c82-ac06-12ecc10368e4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:23.861399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1012/2004] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:23.861855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4fc60-ecc7-4c82-ac06-12ecc10368e4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:23.862277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4fc60-ecc7-4c82-ac06-12ecc10368e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:23.866865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:23.889893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0fb0d-3fba-4f24-8731-7677f0a744d3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:23.892238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-05c4fc60-ecc7-4c82-ac06-12ecc10368e4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:23.894218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-05c4fc60-ecc7-4c82-ac06-12ecc10368e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:24.028473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.029136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.029432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.029709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.030730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.035322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.068818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 993/2005] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:24.069183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.070371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.071134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.116996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1013/2006] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:23 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:24.120406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.127133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:24.139899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] MFA Rules not processed for user `067a03b4e2d6440dbbb950c2bfe90948`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:24.145989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:24.239818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:24.318309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 994/2007] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:24.323921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.364952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40a33-f495-4702-b1c3-64bc1dbde9e2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.372814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.375566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.376100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.376658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.483036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:24.500378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d17b3f-0a6c-4d63-80e5-b2c258dfa2ee None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.510953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.512545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.513096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.513597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.514379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.518977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.519440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.522120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.551226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1014/2008] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:24.552551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.564896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071aaa74-18fb-4bf0-9a70-96c517d15f80 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.566137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 995/2009] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:24 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:24.571171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.576282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.577095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.577478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.578002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.578844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.581006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.592033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef24a5-8bb7-4f5c-a2c7-d20f08012856 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.602248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.604064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.604561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.605049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.606354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.609798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.631116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 996/2010] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:24.632970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1015/2011] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:24 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:24.639984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.641238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.663292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbb78-0544-4d4b-ba4c-a9dbe0d769e7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.789438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.791383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.793172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.793172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.793733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.800987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd0a4d-6a33-4d1d-98d4-303cdd9a2987 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.807998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.812014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.812598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.813072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.813366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.814356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.816713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.841623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 997/2012] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:24.841623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.844624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:24.856976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1016/2013] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:24 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:24.858510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.872386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6dfad-1615-4e61-937c-9d1e4d2cccef admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.882006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7b05-e5e9-44ba-9309-d75f898fe447 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:24.883453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.884666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.884977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.885442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] PATH_INFO: `/v3/projects/36b8b2a55a934185ac1a760323633b78` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.887417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b8b2a55a934185ac1a760323633b78)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.889415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.894371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:24.896617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:24.897220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:24.897790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] PATH_INFO: `/v3/projects/fd00fee47d344857a9cc77e54a6f36e6/users/7aa0b47c60e9416697444271aad12be1/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:24.926655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd00fee47d344857a9cc77e54a6f36e6, user_id=7aa0b47c60e9416697444271aad12be1, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:24.931849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:24.955083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1017/2014] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:24 2022] PUT /identity/v3/projects/fd00fee47d344857a9cc77e54a6f36e6/users/7aa0b47c60e9416697444271aad12be1/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:24.972032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:24.988666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b8b2a55a934185ac1a760323633b78', 'request_id': 'req-32c6ac5e-ef03-4f32-81ca-e529288d52ad'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.011902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b8b2a55a934185ac1a760323633b78', 'request_id': 'req-32c6ac5e-ef03-4f32-81ca-e529288d52ad'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.016442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:25.044274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b8b2a55a934185ac1a760323633b78', 'request_id': 'req-32c6ac5e-ef03-4f32-81ca-e529288d52ad'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.084012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] The token cache is being invalidate because project 36b8b2a55a934185ac1a760323633b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:25.084618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.085634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-32c6ac5e-ef03-4f32-81ca-e529288d52ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.089744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 998/2015] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:24 2022] DELETE /identity/v3/projects/36b8b2a55a934185ac1a760323633b78 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:25.094575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.095472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.095602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.127037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24776-d056-477b-9505-84fa437d81ac admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.145467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] MFA Rules not processed for user `7aa0b47c60e9416697444271aad12be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:25.147666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.206546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:25.267883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 999/2016] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:25.267883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.269653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.286147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.286830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.287117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.287392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.288101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.289761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:25.302025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1018/2017] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:25.303253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.305263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.319009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1db4a-34de-41d3-a01b-5ceb5108ab3a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.326272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.326272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.326272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.326272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] PATH_INFO: `/v3/users/df6f6625fe3c4a04b65bfe8edb845a67` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.328477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6f6625fe3c4a04b65bfe8edb845a67)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.332052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:25.361312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702db75-2903-4a1a-9730-43315e6ef0b6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.374650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.375869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.376324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.376669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] PATH_INFO: `/v3/projects/ec9eab34627e4210b34f9a5703ee5c33` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.378640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9eab34627e4210b34f9a5703ee5c33)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.390489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:25.422030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6f6625fe3c4a04b65bfe8edb845a67'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.423436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6f6625fe3c4a04b65bfe8edb845a67'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.454647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6f6625fe3c4a04b65bfe8edb845a67'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.470868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6f6625fe3c4a04b65bfe8edb845a67'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.472777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6f6625fe3c4a04b65bfe8edb845a67'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.497657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9eab34627e4210b34f9a5703ee5c33', 'request_id': 'req-b777a1bc-74c2-45e2-b24c-63827aac5d26'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.511016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9eab34627e4210b34f9a5703ee5c33', 'request_id': 'req-b777a1bc-74c2-45e2-b24c-63827aac5d26'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.513597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1019/2018] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:25 2022] DELETE /identity/v3/users/df6f6625fe3c4a04b65bfe8edb845a67 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:25.515479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.518822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.524140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9eab34627e4210b34f9a5703ee5c33', 'request_id': 'req-b777a1bc-74c2-45e2-b24c-63827aac5d26'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.540346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] The token cache is being invalidate because project ec9eab34627e4210b34f9a5703ee5c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:25.540673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.542103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:25.544617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1000/2019] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:25 2022] DELETE /identity/v3/projects/ec9eab34627e4210b34f9a5703ee5c33 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:25.546938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.549910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.568145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:25.793890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eb2f6-96ba-40a7-88b0-18a9a38bafbc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.804909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a1bc-74c2-45e2-b24c-63827aac5d26 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.813715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.814630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.815638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.816025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.817145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.819040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.820475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.820990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.821342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:25.821469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.824081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.828254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:25.845399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1001/2020] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:25.849123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.854677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:25.882251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1020/2021] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:25 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:25.882534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c420-3835-48c0-8ee5-edb4c158d1a3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:25.882642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:25.933830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:25.980842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:25.981663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:25.982088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:25.982544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] PATH_INFO: `/v3/users/00252657028649dc8d56ab28c570e0ba` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:25.984295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00252657028649dc8d56ab28c570e0ba)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:25.987418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.001960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30186d-1313-403a-af4c-5920ae3feca9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.011059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.013003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.013434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.013847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] PATH_INFO: `/v3/projects/0778cd0b579e44d387a0a3297001c627/users/f26e607da68e49baadeff6806e454a32/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.042079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0778cd0b579e44d387a0a3297001c627, user_id=f26e607da68e49baadeff6806e454a32, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.047285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.058825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00252657028649dc8d56ab28c570e0ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.066428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1021/2022] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:25 2022] PUT /identity/v3/projects/0778cd0b579e44d387a0a3297001c627/users/f26e607da68e49baadeff6806e454a32/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:26.067060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.068850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.080192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00252657028649dc8d56ab28c570e0ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.104343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00252657028649dc8d56ab28c570e0ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.113551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00252657028649dc8d56ab28c570e0ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.114705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00252657028649dc8d56ab28c570e0ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.124539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1002/2023] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:25 2022] DELETE /identity/v3/users/00252657028649dc8d56ab28c570e0ba => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:26.128836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.130839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.172864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:26.173738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdc06-117f-42f4-ba03-3f1799f41b47 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.321115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fb135-d83d-492d-9fca-f712704c745c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.336638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.343601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.344726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.345214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] PATH_INFO: `/v3/projects/fb994b65ad4c41bbbf84d28a98179716` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.349331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb994b65ad4c41bbbf84d28a98179716)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.354334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.356235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.356690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.364764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.364764 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.365261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.368712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ab17e-5c22-42dd-af69-22e1031916df admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.444933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1022/2024] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:26 2022] POST /identity/v3/users => generated 300 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:26.444933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d9b25-8b28-4142-92d8-4c37af8aff06 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.444933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d9b25-8b28-4142-92d8-4c37af8aff06 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.444933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d9b25-8b28-4142-92d8-4c37af8aff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.455130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb994b65ad4c41bbbf84d28a98179716', 'request_id': 'req-686a0e8f-0c23-4580-8ad7-f34861c167cd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.474389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb994b65ad4c41bbbf84d28a98179716', 'request_id': 'req-686a0e8f-0c23-4580-8ad7-f34861c167cd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.497044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb994b65ad4c41bbbf84d28a98179716', 'request_id': 'req-686a0e8f-0c23-4580-8ad7-f34861c167cd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.510727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ae8d9b25-8b28-4142-92d8-4c37af8aff06 None None] MFA Rules not processed for user `f26e607da68e49baadeff6806e454a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:26.513393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] The token cache is being invalidate because project fb994b65ad4c41bbbf84d28a98179716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:26.514252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.514598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:26.516401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ae8d9b25-8b28-4142-92d8-4c37af8aff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.516760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1003/2025] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:26 2022] DELETE /identity/v3/projects/fb994b65ad4c41bbbf84d28a98179716 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:26.517866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.519979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.620741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a0e8f-0c23-4580-8ad7-f34861c167cd admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.625684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:26.626384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.628262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.628262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.628262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.628720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.631466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc84ca-a962-4c63-b439-3bc635eee4ce admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.649123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1004/2026] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:26.651687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.651970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.652255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.686496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:26.688008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.711109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1005/2027] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:26.715546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.729364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cf30e-fa03-497f-bdb9-f0755abbf797 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.731701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1023/2028] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:26.733283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.733589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.733860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.738727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.739716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.740565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.741246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] PATH_INFO: `/v3/projects/7280d5fd29bf4f8bbb2881382974cc39/users/d7d22b966af245539b34e3562ebe7607/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.770912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:26.772634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.778370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7280d5fd29bf4f8bbb2881382974cc39, user_id=d7d22b966af245539b34e3562ebe7607, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.781664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:26.802567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1024/2029] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:26.806710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.810514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1006/2030] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:26 2022] PUT /identity/v3/projects/7280d5fd29bf4f8bbb2881382974cc39/users/d7d22b966af245539b34e3562ebe7607/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:26.811263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:26.813537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.819764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:26.847129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3916f-09ae-4e97-a908-d686f744c15c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.857912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:26.954504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aea6a-d34f-4118-b49e-e8b39129871f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:26.960909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:26.961698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:26.963343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:26.963747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:26.964560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:26.966672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.008405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1007/2031] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:27.008405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.036420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.037261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.037554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.037830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] PATH_INFO: `/v3/projects/2d75d448906440628119120878c91194` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.039617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d75d448906440628119120878c91194)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.043832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.122059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ad01-2e23-4a44-9e3f-77914ee56a9b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.125811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d75d448906440628119120878c91194', 'request_id': 'req-99b4fa81-874c-443e-8e75-3ba03779ff33'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:27.136299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d75d448906440628119120878c91194', 'request_id': 'req-99b4fa81-874c-443e-8e75-3ba03779ff33'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:27.156531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d75d448906440628119120878c91194', 'request_id': 'req-99b4fa81-874c-443e-8e75-3ba03779ff33'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:27.174548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] The token cache is being invalidate because project 2d75d448906440628119120878c91194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:27.174846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:27.175678 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:27.178542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1025/2032] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:26 2022] DELETE /identity/v3/projects/2d75d448906440628119120878c91194 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:27.179960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.181786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.198754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.201855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.201855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.201855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.201855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:27.201855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.202676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.225488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1008/2033] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:27.225488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.229907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.254397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005484-6fdd-45ca-909c-e5a2f5d2613b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.263218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.263931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.264458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.264796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.265723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.267183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:27.268903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711f16-fc1a-4734-b749-136792710ecf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.271788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4fa81-874c-443e-8e75-3ba03779ff33 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.277875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.278869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.279343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.279779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.280908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.282657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.300949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1009/2034] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/users => generated 295 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:27.302294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.302656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.302943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.309257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1026/2035] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:27.310875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.313660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.325648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:27.326944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.347360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1010/2036] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:27.347360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.347760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9fe3-fec8-4046-a520-03ad58aff362 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.347760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.347760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.348096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.348982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.350195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.353746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748c6dc-7542-4d26-b84e-d717a5f15c8a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.360144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711ec0-a84f-445d-829c-49bec7cfa75d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.369346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.370341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.370702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.371065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.371821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.373687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.385608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1011/2037] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:27.387128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.403983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3ead-f358-4ae5-bd8e-071fe8623427 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.415363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.416798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.417432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.418090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] PATH_INFO: `/v3/projects/7280d5fd29bf4f8bbb2881382974cc39/users/d7d22b966af245539b34e3562ebe7607/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.424331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1027/2038] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:27.424331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.424331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.424331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.427549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7280d5fd29bf4f8bbb2881382974cc39, user_id=d7d22b966af245539b34e3562ebe7607, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.433280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.437746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:27.447991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:27.449498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.460983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1012/2039] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:27 2022] PUT /identity/v3/projects/7280d5fd29bf4f8bbb2881382974cc39/users/d7d22b966af245539b34e3562ebe7607/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:27.468564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.569241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1028/2040] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:27.570489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.581141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25a18-d18a-4466-8fdf-b230b7ada016 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.583837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941fb1b-8a60-4337-9b28-d2c1772df2c4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.586883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.587660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.587955 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.590193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] PATH_INFO: `/v3/projects/c42a61d247134cca99243872ef36f6bc/users/b19eb38b522b441ba5c59422c2bfcde2/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.591659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.592395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.592680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.592965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.594354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.598079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f55f1-1d87-4cfc-a652-2b8e00906dc0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.629211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a61d247134cca99243872ef36f6bc, user_id=b19eb38b522b441ba5c59422c2bfcde2, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.633781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.651606 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1029/2041] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/users => generated 282 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:27.652753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.654218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.654763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.662602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1013/2042] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:27 2022] PUT /identity/v3/projects/c42a61d247134cca99243872ef36f6bc/users/b19eb38b522b441ba5c59422c2bfcde2/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:27.668117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.707787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] MFA Rules not processed for user `d7d22b966af245539b34e3562ebe7607`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:27.710024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.793980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c155c-5e93-4a71-8fea-67f02a562f18 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.804278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.806054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.806054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.807258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.808593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:27.809216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.812407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.841857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1014/2044] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:27.842951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1030/2043] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:27.842951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.843234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.861041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30aece-cd23-43ba-884f-83c16aec9b63 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.861620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2490-a80f-4ddb-af68-0bb80900d602 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.871258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.871963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.872788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.872962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.873387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.873652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.874008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.874232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.875593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.876424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.878817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.879044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.897759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1015/2045] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:27.898857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.907849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1031/2046] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:27.909384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:27.912497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:27.923194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da979f-8d7b-4a9b-a482-a4ab5c38fd2b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:27.935275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:27.936318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:27.950260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:27.950260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:27.950260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:27.950260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:27.969609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:28.003826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7979a-a939-4140-b7bd-66f1f5104ddd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.011913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.013512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.014306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.015116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.018543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1016/2047] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:27 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:28.020271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.037551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.041899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.066151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1032/2048] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:28.068020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.091697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bb48-eb47-4a14-a80c-dc679d939bfd service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.148181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:28.229864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7537-7a06-41f0-83e3-03e675f9f66c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.242499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.243036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.244583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.244915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.245284 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.246140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.247041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.247817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] PATH_INFO: `/v3/projects/c42a61d247134cca99243872ef36f6bc/users/b19eb38b522b441ba5c59422c2bfcde2/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.255811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.258644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a61d247134cca99243872ef36f6bc, user_id=b19eb38b522b441ba5c59422c2bfcde2, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.267152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.269042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.305101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1033/2049] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:28 2022] PUT /identity/v3/projects/c42a61d247134cca99243872ef36f6bc/users/b19eb38b522b441ba5c59422c2bfcde2/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:28.307017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.314806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1017/2050] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:28.316385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.335800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f729-d976-47b0-aaa5-13fcab5890f3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.446004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.446851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.447342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.447869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] PATH_INFO: `/v3/projects/d3b711b1cb6941c8b9076308cf812f4a/users/53aab7a6aa814860b3596252f1373d8e/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.473293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b711b1cb6941c8b9076308cf812f4a, user_id=53aab7a6aa814860b3596252f1373d8e, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.475842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d2b0-9ff9-4694-90d3-a5c3bf0fb13f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.481375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc72d-4928-40ec-8f60-048ce8f94784 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.483598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.484961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.485307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.485871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.487365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.491896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.504891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1018/2051] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:28 2022] PUT /identity/v3/projects/d3b711b1cb6941c8b9076308cf812f4a/users/53aab7a6aa814860b3596252f1373d8e/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:28.506642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.507211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.507766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.535389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1034/2052] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:28 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:28.537251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.556092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225587-6e8d-48fa-89b4-555646ca9271 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.583985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] MFA Rules not processed for user `b19eb38b522b441ba5c59422c2bfcde2`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:28.586430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:28.649599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:28.672616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.674385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.675041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.675874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] PATH_INFO: `/v3/users/7aa0b47c60e9416697444271aad12be1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.679220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa0b47c60e9416697444271aad12be1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.683207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.735946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1019/2053] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:28.735946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.780848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d894a5-2d5e-4de1-8064-7eb62518cc90 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:28.793151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:28.794395 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.795065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.796241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.798525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:28.804163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36614a3-80ee-413f-83c4-3a40f6394695 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:28.805632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa0b47c60e9416697444271aad12be1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:28.806391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa0b47c60e9416697444271aad12be1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:28.833147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1020/2054] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:28.834345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:28.834664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:28.834947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:28.845460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa0b47c60e9416697444271aad12be1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:28.855922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa0b47c60e9416697444271aad12be1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:28.856749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa0b47c60e9416697444271aad12be1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:28.874926 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] MFA Rules not processed for user `53aab7a6aa814860b3596252f1373d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:28.876560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:28.886404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1035/2055] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:28 2022] DELETE /identity/v3/users/7aa0b47c60e9416697444271aad12be1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:28.887605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:28.890842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:28.925946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:29.034411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddaee9-02b8-420a-8003-5835db119665 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.047645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.049689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.049973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.050234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.055754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1021/2056] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:29.057939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.059870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.060129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.087277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a84bbe-7fde-4141-9ac0-d204fbeb7905 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.245466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.246126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.246414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.246725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.247470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.249482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496c9bb-65fc-4fc9-8dd8-443be3752f14 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.262050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1022/2057] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:29.263454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.263748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.264031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.274066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.278080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.288588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:29.289984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.304674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1023/2058] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:29.304674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.304674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.315317 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1036/2059] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:29.317983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.330830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342e038-cb6a-4def-b8a9-50a83b65459f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.340227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.341980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.341980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.342260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.345110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.350942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.368065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8421eb-2631-4666-86bd-a9562b3be5e7 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.396863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.399046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.399402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.405080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] PATH_INFO: `/v3/projects/e11aac632f45420e9507dc4b96898387/users/60152fc729584c28a2db6fb6cca2d89c/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.432882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11aac632f45420e9507dc4b96898387, user_id=60152fc729584c28a2db6fb6cca2d89c, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.436642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.437207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1024/2060] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:29 2022] POST /identity/v3/projects => generated 359 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:29.439449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.443022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.458365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:29.474480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1037/2061] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:29 2022] PUT /identity/v3/projects/e11aac632f45420e9507dc4b96898387/users/60152fc729584c28a2db6fb6cca2d89c/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:29.512379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.522489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.567071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cedfa-ea0c-4ccf-90c8-f95f65630a76 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.635674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:29.647858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.648807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.649180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.649540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.679867 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740337c-3d31-472b-941a-87a927d319e1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.684609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.685086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.685363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.685682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.689989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.790054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.794301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6569f5e-9516-410a-bd0f-301c1cde1e9d service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.797060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.800383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.815755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1038/2062] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:29.818364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.820543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1025/2063] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:29.822798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.823192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.823618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.839907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638efbf-a2be-4d4c-a2e0-836c004c796f service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.858428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.859173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.859605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.859886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.860597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.862589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:29.895664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] MFA Rules not processed for user `60152fc729584c28a2db6fb6cca2d89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:29.899375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:29.944486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1039/2064] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:29 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:29.945751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:29.978721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf910-94b3-41fd-afe5-f1c07cea629d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:29.986718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:29.987864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:29.988497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:29.989050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:29.990218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:29.994873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.015132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1040/2065] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:30.016435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.036534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b052c5-a2e7-4a99-bf6f-a9b84b2caaf4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:30.047321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:30.048282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.048676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.048961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] PATH_INFO: `/v3/projects/15c4ad381713467793cd188beaca190f/users/60e2da3c3e77441c809f350a03ab3a18/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.078581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c4ad381713467793cd188beaca190f, user_id=60e2da3c3e77441c809f350a03ab3a18, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:30.081611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.103507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1041/2066] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:30 2022] PUT /identity/v3/projects/15c4ad381713467793cd188beaca190f/users/60e2da3c3e77441c809f350a03ab3a18/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:30.111687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.129607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1026/2067] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:30.160529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.162302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:30.280073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3a67-545d-4419-b51d-faefeb4587d2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:30.285908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:30.287323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.287790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.288165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.289077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:30.292565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.296036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:30.329110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1042/2068] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:30.331603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.362187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcdb74-8e99-47ee-b4b7-1c3a2151cd15 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:30.368802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5c9e-2085-476c-9f33-a63274842251 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:30.378499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:30.379885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.380346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.380728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] PATH_INFO: `/v3/projects/15c4ad381713467793cd188beaca190f/users/60e2da3c3e77441c809f350a03ab3a18/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.391597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c4ad381713467793cd188beaca190f, user_id=60e2da3c3e77441c809f350a03ab3a18, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:30.395431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a865d-c693-4b27-8d52-756f027986d0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.413017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:30.473929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1043/2069] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:30 2022] PUT /identity/v3/projects/15c4ad381713467793cd188beaca190f/users/60e2da3c3e77441c809f350a03ab3a18/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:30.487732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.488027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.488314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.510164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:30.510861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.511176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.511522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.588239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] MFA Rules not processed for user `60e2da3c3e77441c809f350a03ab3a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:30.593280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:30.615931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:30.618285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.647449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1027/2070] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:30.648430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.653520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:30.671471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815c-f14b-4f49-b68a-425f967781ff service glance] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:30.768385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:30.769083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:30.769374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:30.769735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] PATH_INFO: `/v3/projects/fd00fee47d344857a9cc77e54a6f36e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:30.772336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd00fee47d344857a9cc77e54a6f36e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:30.777126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:30.853338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1044/2071] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:30.875995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:30.939095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd00fee47d344857a9cc77e54a6f36e6', 'request_id': 'req-b96b88ee-117c-4eb7-a828-e63723f6392d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:30.958076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd00fee47d344857a9cc77e54a6f36e6', 'request_id': 'req-b96b88ee-117c-4eb7-a828-e63723f6392d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:30.971983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd00fee47d344857a9cc77e54a6f36e6', 'request_id': 'req-b96b88ee-117c-4eb7-a828-e63723f6392d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:30.992297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] The token cache is being invalidate because project fd00fee47d344857a9cc77e54a6f36e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:30.994369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:30.995805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:30.998504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1028/2072] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:30 2022] DELETE /identity/v3/projects/fd00fee47d344857a9cc77e54a6f36e6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:31.003923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:31.009196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:31.047111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:31.093815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139aa5d-5f56-4f99-88b3-915763ea7fc4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:31.233415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:31.236323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:31.236732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:31.237554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:31.248188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:31.271104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b88ee-117c-4eb7-a828-e63723f6392d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:31.291298 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:31.292523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:31.293085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:31.293581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] PATH_INFO: `/v3/users/d7d22b966af245539b34e3562ebe7607` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:31.310625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d22b966af245539b34e3562ebe7607)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:31.319851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:31.457323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:31.468911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d22b966af245539b34e3562ebe7607'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:31.486847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d22b966af245539b34e3562ebe7607'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:31.514006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d22b966af245539b34e3562ebe7607'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:31.528901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d22b966af245539b34e3562ebe7607'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:31.529507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d22b966af245539b34e3562ebe7607'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:31.540446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1029/2073] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:31 2022] DELETE /identity/v3/users/d7d22b966af245539b34e3562ebe7607 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:31.591866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:31.601385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805e53-ed0e-42dc-8327-a7852bc981f2 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:31.641643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1045/2074] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:33.155445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:33.157136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:33.335809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c975d-74a4-47c7-9d2e-88615f19edf8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:33.347007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:33.351727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:33.352531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:33.352896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] PATH_INFO: `/v3/users/53aab7a6aa814860b3596252f1373d8e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:33.356113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53aab7a6aa814860b3596252f1373d8e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:33.359558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:33.442774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:33.495956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53aab7a6aa814860b3596252f1373d8e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.515454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53aab7a6aa814860b3596252f1373d8e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.538126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53aab7a6aa814860b3596252f1373d8e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.563616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53aab7a6aa814860b3596252f1373d8e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.564581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53aab7a6aa814860b3596252f1373d8e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.586865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:33.587711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:33.588413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:33.591666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1030/2075] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:33 2022] DELETE /identity/v3/users/53aab7a6aa814860b3596252f1373d8e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:33.627853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:33.627853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:33.739802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:33.740409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1046/2076] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:33.752740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:33.761343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:33.762979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:33.782604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755408-64c2-43a5-b212-4344a7d80c3f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:33.788531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:33.789211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:33.789495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:33.789774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] PATH_INFO: `/v3/projects/7280d5fd29bf4f8bbb2881382974cc39` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:33.792003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7280d5fd29bf4f8bbb2881382974cc39)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:33.795021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:33.883724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236fc5-8871-4b36-9e78-c55e8298756c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:33.896748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7280d5fd29bf4f8bbb2881382974cc39', 'request_id': 'req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.913605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7280d5fd29bf4f8bbb2881382974cc39', 'request_id': 'req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.928173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7280d5fd29bf4f8bbb2881382974cc39', 'request_id': 'req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.951168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:33.952243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:33.952897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:33.953602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:33.960037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] The token cache is being invalidate because project 7280d5fd29bf4f8bbb2881382974cc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:33.960563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.961902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7b2cf491-7faa-4f09-82a5-0921c1e5d89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:33.984237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1031/2077] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:33 2022] DELETE /identity/v3/projects/7280d5fd29bf4f8bbb2881382974cc39 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:33.988488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:33.988915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:33.989365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.045842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:34.051125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.093434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:34.098232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.100141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe31466-b937-4098-8649-a9e8871ea0e4 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.123531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1047/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:34.206760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1032/2079] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:34.214929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.215419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.215855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.229506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.231431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.248586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c66d63-46de-4faf-97bb-ff4556a0210c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.254777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:34.255293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:34.255780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.256209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.256379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.256674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] PATH_INFO: `/v3/users/067a03b4e2d6440dbbb950c2bfe90948` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.258079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067a03b4e2d6440dbbb950c2bfe90948)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.260892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.275487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1048/2080] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:34.282470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.312223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:34.316936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c46af-4bf8-4763-ae38-2e39ffb7f3f5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.325599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:34.327393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.327718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.329361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.332574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:34.333088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.335715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.366374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067a03b4e2d6440dbbb950c2bfe90948'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.381883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1049/2081] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:34.385844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.414762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067a03b4e2d6440dbbb950c2bfe90948'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.435273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d0f3-6129-45db-ac00-9b82d4ed921c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.465230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:34.467802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.468110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.468395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.470484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067a03b4e2d6440dbbb950c2bfe90948'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.481609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.488775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.519344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067a03b4e2d6440dbbb950c2bfe90948'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.522622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-94958ecd-bbb0-45f5-b8bd-74967a893ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067a03b4e2d6440dbbb950c2bfe90948'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.544564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1033/2082] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:34 2022] DELETE /identity/v3/users/067a03b4e2d6440dbbb950c2bfe90948 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:34.549175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.550523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.550967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.604834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:34.606117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.636023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1050/2083] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:34 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:34.643130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.646099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.756149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc63e12-e8c6-4e2b-828c-9d8eba2be72d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.761676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1034/2084] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:34.770595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:34.773236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.773794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.774072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.774388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.777022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.777164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.780222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.823401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1051/2085] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:34 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:34.824892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:34.828309 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:34.844045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3138d3-6302-4f99-b90d-4f22c326f0f7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.849763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:34.850861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:34.851609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:34.852479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] PATH_INFO: `/v3/projects/d3b711b1cb6941c8b9076308cf812f4a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:34.855089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b711b1cb6941c8b9076308cf812f4a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:34.857626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:34.907170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300da2f-b683-49c3-ae79-be713f97e3d3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:34.925152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b711b1cb6941c8b9076308cf812f4a', 'request_id': 'req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.937195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b711b1cb6941c8b9076308cf812f4a', 'request_id': 'req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:34.969413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b711b1cb6941c8b9076308cf812f4a', 'request_id': 'req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.007992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] The token cache is being invalidate because project d3b711b1cb6941c8b9076308cf812f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:35.008411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.010079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.016271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1052/2086] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:34 2022] DELETE /identity/v3/projects/d3b711b1cb6941c8b9076308cf812f4a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:35.016271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.017145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.022870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.023755 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.024170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.024683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.029904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.051853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:35.072567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:35.162631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.165881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.169645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b1a8-9d46-421c-8c47-993d9adc1cc6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.177184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.178016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.178378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.178782 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.179574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.182000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.182860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1035/2087] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:35.183757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.185814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.205599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14170b-0436-453f-8e96-f67f8cbfc748 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.212871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.213866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.213866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.214179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] PATH_INFO: `/v3/users/60e2da3c3e77441c809f350a03ab3a18` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.215377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e2da3c3e77441c809f350a03ab3a18)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.217382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.219335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1053/2088] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:35.224109 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.246600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5273-4229-471c-b975-08c4a92dfed6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.258252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.258746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.259185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.260186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.262372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.264189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.289808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1054/2089] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:35.296087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.303812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e2da3c3e77441c809f350a03ab3a18'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.313599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872076-ef03-4036-bff6-424de6b226ed admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.320788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.321537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e2da3c3e77441c809f350a03ab3a18'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.322358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.322741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.323019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] PATH_INFO: `/v3/projects/22f2f6a4d9824095bbd4a38a9e7a966f/users/9b7603f7bf9042a38e03fa53db41230a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.343446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2f6a4d9824095bbd4a38a9e7a966f, user_id=9b7603f7bf9042a38e03fa53db41230a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.347174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f68f5-df89-4607-9f55-d86720bc8d4a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.352171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e2da3c3e77441c809f350a03ab3a18'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.371119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e2da3c3e77441c809f350a03ab3a18'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.371291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1055/2090] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:35 2022] PUT /identity/v3/projects/22f2f6a4d9824095bbd4a38a9e7a966f/users/9b7603f7bf9042a38e03fa53db41230a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:35.372646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e2da3c3e77441c809f350a03ab3a18'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:35.392390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.393252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.393531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.398599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1036/2091] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:35 2022] DELETE /identity/v3/users/60e2da3c3e77441c809f350a03ab3a18 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:35.456906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] MFA Rules not processed for user `9b7603f7bf9042a38e03fa53db41230a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:35.461079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.586427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1056/2092] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:35.603836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.605871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.696473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991648-d0e8-4569-8c74-7575799c23dc admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.701482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.708538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.708538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.708538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.719148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.720957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.738156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1037/2093] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:35.789060 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.792733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:35.904249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f6d7-3fa0-4f76-a97a-ed8766c9ab97 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:35.909640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:35.910344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:35.910674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:35.910956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] PATH_INFO: `/v3/projects/590d91626f9e460a810ce97fc031b057` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:35.912180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590d91626f9e460a810ce97fc031b057)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:35.914115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:35.923412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:35.980656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:35.986151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:36.008639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590d91626f9e460a810ce97fc031b057', 'request_id': 'req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.018230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590d91626f9e460a810ce97fc031b057', 'request_id': 'req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.028117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252060-0456-4a6e-9afb-2016c290711c service glance] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:36.033794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590d91626f9e460a810ce97fc031b057', 'request_id': 'req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.054774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] The token cache is being invalidate because project 590d91626f9e460a810ce97fc031b057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:36.055085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.055777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.057965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1057/2094] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:35 2022] DELETE /identity/v3/projects/590d91626f9e460a810ce97fc031b057 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:36.061594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:36.063460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:36.079971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:36.160958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cefbc9-2a2a-46ef-aa90-04fb367a7e79 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:36.162982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:36.163801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.164218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.164800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] PATH_INFO: `/v3/projects/15c4ad381713467793cd188beaca190f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.166208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c4ad381713467793cd188beaca190f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:36.168310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:36.168590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:36.169273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.169560 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.169851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] PATH_INFO: `/v3/users/f26e607da68e49baadeff6806e454a32` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.171426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26e607da68e49baadeff6806e454a32)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:36.173520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:36.263159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c4ad381713467793cd188beaca190f', 'request_id': 'req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.290371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c4ad381713467793cd188beaca190f', 'request_id': 'req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.297412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26e607da68e49baadeff6806e454a32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.298432 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26e607da68e49baadeff6806e454a32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.303714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c4ad381713467793cd188beaca190f', 'request_id': 'req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.319142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] The token cache is being invalidate because project 15c4ad381713467793cd188beaca190f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:36.319514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.321092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7e0ab591-3557-4d2b-bc15-3840ffe3d3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.323803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1038/2095] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:35 2022] DELETE /identity/v3/projects/15c4ad381713467793cd188beaca190f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:36.325863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26e607da68e49baadeff6806e454a32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.331210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.331489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.331783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.340373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26e607da68e49baadeff6806e454a32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.341378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-97c47afa-e767-41c6-8681-b0076b3b096d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26e607da68e49baadeff6806e454a32'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:36.364876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:36.367064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:36.373246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1058/2096] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:36 2022] DELETE /identity/v3/users/f26e607da68e49baadeff6806e454a32 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:36.503842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1039/2097] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:36.531819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.532169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.532453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.606694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:36.612571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:36.640591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1059/2098] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:36.648534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:36.680054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862bf0c-05fc-44b6-a3b3-d1dfdf5d2f95 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:36.723593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:36.725174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.737688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.738178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.738892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:36.739262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:36.740948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:36.786520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1040/2099] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:36.789244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:36.805833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71c22a-527b-44b0-9e99-d975f8414973 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:36.814422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:36.815455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:36.815968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:36.816452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:36.817734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:36.821403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:36.831808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:36.909970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1060/2100] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:36 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:36.911000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:36.930585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5678-f54c-418f-9573-54e5d88d6210 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.012949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:37.017919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.020757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:37.067092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.068129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.068610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.069151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.070402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.073971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.109541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1041/2101] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:36 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:37.119096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.139512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333e62-f4c7-46ea-9b2b-83a4066a192f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.146664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.147330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.147610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.147888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.148599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.150857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.158690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50ea9-65a1-4c6c-8a84-4827bf817fed admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.162707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1042/2102] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:37.164418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.165091 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.165415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.165710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] PATH_INFO: `/v3/projects/0778cd0b579e44d387a0a3297001c627` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.166811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.167010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0778cd0b579e44d387a0a3297001c627)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.169915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.177630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92193-4192-459f-b087-6e9be5579cd5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.182787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.183434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.183727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.184176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.184699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.186356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.202954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1043/2103] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:37.204894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.221559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb37a4-c031-4075-b28f-122e3cdfc47f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.234740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0778cd0b579e44d387a0a3297001c627', 'request_id': 'req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.240936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0778cd0b579e44d387a0a3297001c627', 'request_id': 'req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.248491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0778cd0b579e44d387a0a3297001c627', 'request_id': 'req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.266780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] The token cache is being invalidate because project 0778cd0b579e44d387a0a3297001c627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:37.267055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.268244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.269824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1061/2104] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:37 2022] DELETE /identity/v3/projects/0778cd0b579e44d387a0a3297001c627 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:37.274258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.276410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:37.333895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.334626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.334934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.337392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] PATH_INFO: `/v3/projects/132fb3569b1549d3846e55632674a39b/users/01be647b32424cd3b92b24cc55b306b7/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.357725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=132fb3569b1549d3846e55632674a39b, user_id=01be647b32424cd3b92b24cc55b306b7, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.360642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f43e4-d53c-4551-9b9a-161a1f6309bc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.369217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466635a1-2e18-475d-9fb1-7a0d0be6f8b6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.376179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.377005 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.377364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.377802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] PATH_INFO: `/v3/users/b19eb38b522b441ba5c59422c2bfcde2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.379855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19eb38b522b441ba5c59422c2bfcde2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.383428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.386563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1044/2105] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:37 2022] PUT /identity/v3/projects/132fb3569b1549d3846e55632674a39b/users/01be647b32424cd3b92b24cc55b306b7/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:37.402405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.403687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.405671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.411930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:37.453545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] MFA Rules not processed for user `01be647b32424cd3b92b24cc55b306b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:37.454969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:37.470020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19eb38b522b441ba5c59422c2bfcde2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.471147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19eb38b522b441ba5c59422c2bfcde2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.490722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19eb38b522b441ba5c59422c2bfcde2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.499310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19eb38b522b441ba5c59422c2bfcde2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.500110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19eb38b522b441ba5c59422c2bfcde2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:37.516285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1062/2106] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:37 2022] DELETE /identity/v3/users/b19eb38b522b441ba5c59422c2bfcde2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:37.573398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1045/2107] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:37.579110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.581367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:37.719161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b076-94fd-4a55-85ad-8fd8900684c8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.725141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:37.725996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:37.726420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:37.726899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:37.727735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:37.730469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:37.785504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1063/2108] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:37 2022] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:37.786892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.847704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:37.935031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e9ed-9a3d-424b-a466-a81461ce14ce None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:37.944568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:37.946427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.061401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.062046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.062330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.062639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.063327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.066231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.083471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384381-262a-44f8-bd80-267391715abe admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.092694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.093476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.094095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.094691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] PATH_INFO: `/v3/projects/c42a61d247134cca99243872ef36f6bc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.097016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42a61d247134cca99243872ef36f6bc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.101059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.102323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1046/2109] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:37 2022] POST /identity/v3/users => generated 290 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:38.109784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.134548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23f5-0f32-4595-8b82-7cf5deb4eb1e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.143698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.144823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.146038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.146583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.148061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:38.148900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.158914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.177218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1047/2110] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:38.181766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.192770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a22f6-6aba-4895-830d-45e2f8cdc993 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.199577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42a61d247134cca99243872ef36f6bc', 'request_id': 'req-0b8f264c-f6b8-444a-b267-40b01fe43dc0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:38.206769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42a61d247134cca99243872ef36f6bc', 'request_id': 'req-0b8f264c-f6b8-444a-b267-40b01fe43dc0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:38.215253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42a61d247134cca99243872ef36f6bc', 'request_id': 'req-0b8f264c-f6b8-444a-b267-40b01fe43dc0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:38.242011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] The token cache is being invalidate because project c42a61d247134cca99243872ef36f6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:38.242680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:38.244946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b8f264c-f6b8-444a-b267-40b01fe43dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:38.248644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1064/2111] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:37 2022] DELETE /identity/v3/projects/c42a61d247134cca99243872ef36f6bc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:38.256038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b35a-5c96-4f4a-8175-db23095ea83e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.256564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b35a-5c96-4f4a-8175-db23095ea83e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.257137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b35a-5c96-4f4a-8175-db23095ea83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.280061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.280977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.281266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.281563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] PATH_INFO: `/v3/projects/b011584e829145e7961101ca06249d2d/users/717342579a9f45d2897a0fd485792f7e/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.295340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-63d1b35a-5c96-4f4a-8175-db23095ea83e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:38.297641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-63d1b35a-5c96-4f4a-8175-db23095ea83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.305471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b011584e829145e7961101ca06249d2d, user_id=717342579a9f45d2897a0fd485792f7e, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.308364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.309028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1065/2112] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:38.317929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.318246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.318750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.328350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1048/2113] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:38 2022] PUT /identity/v3/projects/b011584e829145e7961101ca06249d2d/users/717342579a9f45d2897a0fd485792f7e/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:38.330852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.333528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.345294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:38.351300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.405371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:38.462011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454016d-d743-4683-8410-77cfc0335c6a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.468158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.469631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.469932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.470218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.471008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.477741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1066/2114] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:38.478679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.486385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.498428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1049/2115] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:38.502779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.505294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084565-37f7-4513-94f3-a2930bd5bef6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.513997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.514474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beaeb2-ae05-4d85-8beb-8375d58bb7f5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.515081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.515574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.516615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.517364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:38.518196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.521347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5b156-13ba-4aad-aaff-498a68be5641 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.521654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.522722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.522980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.523464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] PATH_INFO: `/v3/projects/b011584e829145e7961101ca06249d2d/users/717342579a9f45d2897a0fd485792f7e/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.527456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b011584e829145e7961101ca06249d2d, user_id=717342579a9f45d2897a0fd485792f7e, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.534632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.552878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1050/2116] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:38 2022] PUT /identity/v3/projects/b011584e829145e7961101ca06249d2d/users/717342579a9f45d2897a0fd485792f7e/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:38.559847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1067/2117] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:38.561314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.564829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.565118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.565430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.610731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] MFA Rules not processed for user `717342579a9f45d2897a0fd485792f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:38.612234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.658425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be082c-012d-423c-bed9-13ea234b2f14 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.664782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.665990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.666281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.666628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.667312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.669324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.711264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1051/2118] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:38.712175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.726639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1068/2119] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:38.739781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.741757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:38.765772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:38.794814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28771061-d1d6-471b-b669-13bdeaceb747 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.800225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.800990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.801378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.801731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.802520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.804772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.821403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa9380-7149-4686-83a0-47817697d092 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.840210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1052/2120] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:38 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:38.840832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.856321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96db34-780c-4f8f-b63d-ce536f7f7973 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.861614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.863312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.863312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.863312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.863650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.865864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.880346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1053/2121] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:38.884428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.906162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41ff5-8daf-4079-8161-20ab71f70d00 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.912834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.913644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.914200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.914615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.916101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.918590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:38.934651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1054/2122] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:38.937092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:38.938901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.942707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.943000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.943279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.952165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:38.962890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4974-9a89-4d19-9181-fbfe2123f7cb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:38.970414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:38.971103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:38.971389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:38.971879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] PATH_INFO: `/v3/projects/302f0d0c2a60452a83ad5d8caca54db0/users/9eb79381c899432b86741865f5caf83d/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:38.991569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=302f0d0c2a60452a83ad5d8caca54db0, user_id=9eb79381c899432b86741865f5caf83d, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:38.994311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf1381-b611-44da-a2f5-9d6699a7cb3b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.015820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1055/2123] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:38 2022] PUT /identity/v3/projects/302f0d0c2a60452a83ad5d8caca54db0/users/9eb79381c899432b86741865f5caf83d/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:39.028178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.028615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.028985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.031260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.032772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.045206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1069/2124] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:39.089603 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] MFA Rules not processed for user `9eb79381c899432b86741865f5caf83d`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:39.093463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:39.155006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.164831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88886-ed77-46a9-83c0-0197ee589bb8 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.195936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1056/2125] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:39.202997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.229201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.229853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.230141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.230417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.232568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:39.278481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:39.297036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5321d-4ebf-4fee-b861-b5cd257527c9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.303413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.304364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.304691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.304943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.305634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.307752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.322413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.323935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.334311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1070/2126] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:39.343465 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1057/2127] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:39.347578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.359926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fc8b4-6464-4c79-bd79-275c553d08af service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.479780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.481448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.482605 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.483391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.485474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.490251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.543625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.552046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1071/2128] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:39 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:39.560217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370504-bd52-43a6-a1b2-7d9c2aff5f7d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.566063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.566995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.567856 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.568266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.569190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.571155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.603586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1058/2129] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:39.607700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.620025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d903a2-5713-4f0a-bf80-4d1592f84ead admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.625450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.626758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.627126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.627483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] PATH_INFO: `/v3/projects/bc8dbc24ba13405b80a36d593592537d/users/eaa76b40719f4853b393c87825640f68/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.672414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8dbc24ba13405b80a36d593592537d, user_id=eaa76b40719f4853b393c87825640f68, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.675391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.701333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1072/2130] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:39 2022] PUT /identity/v3/projects/bc8dbc24ba13405b80a36d593592537d/users/eaa76b40719f4853b393c87825640f68/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:39.702301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.724301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcb547-8fbd-47d1-963b-3b4a5f417083 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.864453 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:39.895035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.895832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.896188 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.896475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.897317 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.901445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdebd2-b713-4f8e-8289-768fc037e9ed admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:39.938712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1059/2131] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:39.944682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:39.961136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e519c9-a92e-4839-af15-c733ef33246e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:39.971228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:39.972416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:39.972906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:39.974486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] PATH_INFO: `/v3/projects/bc8dbc24ba13405b80a36d593592537d/users/eaa76b40719f4853b393c87825640f68/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:39.977529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8dbc24ba13405b80a36d593592537d, user_id=eaa76b40719f4853b393c87825640f68, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:39.983689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:40.001790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1073/2132] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:39 2022] PUT /identity/v3/projects/bc8dbc24ba13405b80a36d593592537d/users/eaa76b40719f4853b393c87825640f68/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:40.013181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:40.013476 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:40.013759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:40.048427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] MFA Rules not processed for user `eaa76b40719f4853b393c87825640f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:40.049687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:40.139764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1060/2133] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:40.153768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:40.246426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b9e3-dce7-437d-83c1-c368bd41badc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:40.252920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:40.254270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:40.254270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:40.254270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:40.270030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:40.271650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196dbf-d8ca-4796-833b-93e1bac839ff service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:40.285151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1074/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:41.409651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:41.535859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9db3-c5af-4ba1-8efd-d3dacfa4148e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:41.545471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:41.546717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:41.547235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:41.547741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] PATH_INFO: `/v3/users/9eb79381c899432b86741865f5caf83d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:41.550729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb79381c899432b86741865f5caf83d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:41.556878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:41.645326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb79381c899432b86741865f5caf83d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:41.658769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb79381c899432b86741865f5caf83d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:41.686674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:41.697609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb79381c899432b86741865f5caf83d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:41.714418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb79381c899432b86741865f5caf83d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:41.715402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb79381c899432b86741865f5caf83d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:41.729414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1061/2135] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:41 2022] DELETE /identity/v3/users/9eb79381c899432b86741865f5caf83d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:41.732953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:41.733879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:41.734512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:41.768731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:41.770341 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:41.808407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:41.862798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1075/2136] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:41.873452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:41.875168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:41.946176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b767-f10e-4baa-b43d-f4e32cebe42a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:41.950746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:41.951319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:41.951609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:41.951894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:41.962113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:41.963673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:41.974880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1062/2137] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:42.650494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:42.652353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:42.679575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5fc3-c84e-497d-9597-ca6930fb80e8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:42.687371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:42.688123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:42.688414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:42.688695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] PATH_INFO: `/v3/projects/302f0d0c2a60452a83ad5d8caca54db0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:42.689978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=302f0d0c2a60452a83ad5d8caca54db0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:42.691909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:42.785713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302f0d0c2a60452a83ad5d8caca54db0', 'request_id': 'req-0c0824de-bbd1-4b63-838e-7ef224296f7d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:42.797006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302f0d0c2a60452a83ad5d8caca54db0', 'request_id': 'req-0c0824de-bbd1-4b63-838e-7ef224296f7d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:42.805178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302f0d0c2a60452a83ad5d8caca54db0', 'request_id': 'req-0c0824de-bbd1-4b63-838e-7ef224296f7d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:42.840805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] The token cache is being invalidate because project 302f0d0c2a60452a83ad5d8caca54db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:42.841200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:42.842055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:42.844039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1076/2138] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:42 2022] DELETE /identity/v3/projects/302f0d0c2a60452a83ad5d8caca54db0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:42.848551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:42.868076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e11a-00ca-4479-aafe-d1a3fed9aa94 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:43.053834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:43.055977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:43.056803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:43.057643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] PATH_INFO: `/v3/users/eaa76b40719f4853b393c87825640f68` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:43.061344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa76b40719f4853b393c87825640f68)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:43.075747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:43.185695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:43.188378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:43.219285 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0824de-bbd1-4b63-838e-7ef224296f7d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:43.224970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:43.225638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:43.225966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:43.226214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] PATH_INFO: `/v3/users/9e0305cbb5a9491c85a89d0b40cb821a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:43.228248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0305cbb5a9491c85a89d0b40cb821a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:43.230959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:43.245766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa76b40719f4853b393c87825640f68'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.264451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa76b40719f4853b393c87825640f68'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.284639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa76b40719f4853b393c87825640f68'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.297247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa76b40719f4853b393c87825640f68'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.298128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa76b40719f4853b393c87825640f68'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.307154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1063/2139] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:42 2022] DELETE /identity/v3/users/eaa76b40719f4853b393c87825640f68 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:43.322198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0305cbb5a9491c85a89d0b40cb821a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.323489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0305cbb5a9491c85a89d0b40cb821a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.349245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0305cbb5a9491c85a89d0b40cb821a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.374844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0305cbb5a9491c85a89d0b40cb821a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.375776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0305cbb5a9491c85a89d0b40cb821a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:43.406270 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1077/2140] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:43 2022] DELETE /identity/v3/users/9e0305cbb5a9491c85a89d0b40cb821a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:43.755550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:43.760794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:43.773995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:43.794505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:43.796814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:43.906238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:43.927996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057630b-27dc-424d-9434-61a89fa869d9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:43.973015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784f01-48d9-44c2-8171-bed76509413c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:43.981192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:43.981819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:43.982211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:43.982650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] PATH_INFO: `/v3/projects/bc8dbc24ba13405b80a36d593592537d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:43.987421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8dbc24ba13405b80a36d593592537d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:43.989742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.028628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.030315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.031156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.031728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] PATH_INFO: `/v3/projects/76ff7a3700a24217bcd8474d46717c92` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.034430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ff7a3700a24217bcd8474d46717c92)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.037434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.075058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8dbc24ba13405b80a36d593592537d', 'request_id': 'req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.090224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8dbc24ba13405b80a36d593592537d', 'request_id': 'req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.098933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8dbc24ba13405b80a36d593592537d', 'request_id': 'req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.116856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] The token cache is being invalidate because project bc8dbc24ba13405b80a36d593592537d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:44.117134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.117857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-503fbfc4-e7b1-4259-9fe8-7c83b0d0ed0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.120896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1078/2141] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:43 2022] DELETE /identity/v3/projects/bc8dbc24ba13405b80a36d593592537d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:44.126079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a39d6-f15e-4a29-9294-87cbd05ddd46 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.126775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a39d6-f15e-4a29-9294-87cbd05ddd46 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.127142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a39d6-f15e-4a29-9294-87cbd05ddd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.155316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ff7a3700a24217bcd8474d46717c92', 'request_id': 'req-2078e578-6b0c-4843-b6e4-722429251e0e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.156920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-704a39d6-f15e-4a29-9294-87cbd05ddd46 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.158503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-704a39d6-f15e-4a29-9294-87cbd05ddd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.166533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ff7a3700a24217bcd8474d46717c92', 'request_id': 'req-2078e578-6b0c-4843-b6e4-722429251e0e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.174422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ff7a3700a24217bcd8474d46717c92', 'request_id': 'req-2078e578-6b0c-4843-b6e4-722429251e0e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.203872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] The token cache is being invalidate because project 76ff7a3700a24217bcd8474d46717c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:44.205118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.206653 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2078e578-6b0c-4843-b6e4-722429251e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:44.210150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1064/2142] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:43 2022] DELETE /identity/v3/projects/76ff7a3700a24217bcd8474d46717c92 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:44.215950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b09-75cc-4280-bdd0-30bb033fe289 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.216469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b09-75cc-4280-bdd0-30bb033fe289 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.216918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b09-75cc-4280-bdd0-30bb033fe289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.248205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-eccb4b09-75cc-4280-bdd0-30bb033fe289 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.249500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-eccb4b09-75cc-4280-bdd0-30bb033fe289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.268877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1079/2143] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:44.279537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.279875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.280210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.295888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:44.302571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.304150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.314801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1080/2144] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:44.319405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.324682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1065/2145] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:44.329539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a10a-5195-4ddd-a540-e86500150b4b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.333208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.333544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.333855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.335207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.335923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.336217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.336538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.337365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:44.337687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.339349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.353409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1081/2146] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:44.356645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.358061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.358928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.366536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1066/2147] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:44.371936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.375759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6f75-1c33-4620-be85-dfe93d589bc0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.386537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7cbb8-ce34-4c73-a960-ef121ce371dc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.390199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.390674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.391169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.391609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.393475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.396864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.403731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.404851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.405299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.406048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.407190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:44.407747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.410241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.436612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1067/2148] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:12:44.438477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.452661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce3dd-35c7-468b-b2a9-8dcda006dcf4 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.460810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1082/2149] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:44.462395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.467711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.468698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.469067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.471975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.472931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.475126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.488405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:44.516934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1068/2150] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:44.523729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.552919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e4e0-d5f1-43a0-b5ac-82ddf5abe5f4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.638713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddf73-778d-4036-a4cb-bec44a237269 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.640267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.640907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.641194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.641473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.642164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.644157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.644390 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.644790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.645128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.645399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.646079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.648089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.674593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1083/2151] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:44.674927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1069/2152] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:44.675968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.677218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.690138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cf03-6af7-45b0-ac0e-327a7ecd7f5c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.691662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cf254-4bc0-44b6-a40d-36935377aad5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.697573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.698220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.698529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.698803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.699518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.700956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.701156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.702011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.702567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.703065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.704253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.706678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.716703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1084/2153] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:44.720287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.732764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1070/2154] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:44.735525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.735768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0b55-a377-4cf4-b2c6-065d7ede4c00 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.740966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.741600 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.741885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.742164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.742917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.744579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.751485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba835-81a3-4a93-8ab6-6d0ed9b1bd73 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.756492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1085/2155] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:44.762115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.764780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.765888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.766484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.766893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.767941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.770095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.774218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac00c7-1f95-4b0c-9d39-520c951ef8a0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.781123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.782286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.782834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.783333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] PATH_INFO: `/v3/projects/f0d5262d3aac4209b41156448d78e1b7/users/4d17514f1d6545418f15980823f28ef8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.783695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1071/2156] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:44.788385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.799521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981401-366c-487b-ae3a-10d8a9f0bb4d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:44.804622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:44.805403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.805698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.806015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] PATH_INFO: `/v3/projects/8bf1655c29144bb2a7d925a5a5b22bdb/users/023c699e0cac426f8e7229ebbb7727b7/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.812607 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d5262d3aac4209b41156448d78e1b7, user_id=4d17514f1d6545418f15980823f28ef8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.815994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb32b9-223b-44b5-bc2b-8fdc68744a72 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.827348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf1655c29144bb2a7d925a5a5b22bdb, user_id=023c699e0cac426f8e7229ebbb7727b7, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:44.830086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc27f3-245d-46a2-987a-365afeac6dbb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:44.833267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1086/2157] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:44 2022] PUT /identity/v3/projects/f0d5262d3aac4209b41156448d78e1b7/users/4d17514f1d6545418f15980823f28ef8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:44.845462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.845773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.846030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.848168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1072/2158] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:44 2022] PUT /identity/v3/projects/8bf1655c29144bb2a7d925a5a5b22bdb/users/023c699e0cac426f8e7229ebbb7727b7/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:44.853381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:44.853669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:44.853947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:44.875588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.877062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.881637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] MFA Rules not processed for user `4d17514f1d6545418f15980823f28ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:44.884680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.930709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:44.953161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1073/2159] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:44.963420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.966211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:44.967955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:44.979405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1087/2160] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:44.993968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:44.997129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.046528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84777d-5a00-4c79-9fa8-bea6dc6c069f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.051732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.053017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.053514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.054136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.068206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.069614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.071209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8958d1-80b2-4a39-81b9-0b108d969a4e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.076846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.077490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.077948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.078281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.081426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1074/2161] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:45.088076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.089601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1229ad-0068-4b9a-91a5-ebcef3f22655 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.103168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1088/2162] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:45.127997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:45.151497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f05963-204a-4f55-84ed-86214a640531 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.156579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.157247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.157537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.157820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] PATH_INFO: `/v3/users/4d17514f1d6545418f15980823f28ef8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.159399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d17514f1d6545418f15980823f28ef8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.161449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.239872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d17514f1d6545418f15980823f28ef8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.256223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d17514f1d6545418f15980823f28ef8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.273336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d17514f1d6545418f15980823f28ef8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.283652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d17514f1d6545418f15980823f28ef8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.284351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d17514f1d6545418f15980823f28ef8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.296817 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1075/2163] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:45 2022] DELETE /identity/v3/users/4d17514f1d6545418f15980823f28ef8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:45.298807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.299331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.299801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.326064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:45.327517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.444176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1089/2164] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:45.462902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:45.463496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:45.464461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.464935 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.484990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a231c-3343-4707-afb9-98be911b0900 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.490278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.491049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.491343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.491624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] PATH_INFO: `/v3/users/01be647b32424cd3b92b24cc55b306b7` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.492839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=01be647b32424cd3b92b24cc55b306b7)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.495937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.553368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01be647b32424cd3b92b24cc55b306b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.553516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dd77e-7c6a-4c60-b0e0-a6c7b48fdf94 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.561722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:45.565774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01be647b32424cd3b92b24cc55b306b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.582332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.584008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.584302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.584744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.586377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01be647b32424cd3b92b24cc55b306b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.599952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.600747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01be647b32424cd3b92b24cc55b306b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.602094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.602649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-28fd6e61-6eb9-40c5-9860-3e61f69fb4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01be647b32424cd3b92b24cc55b306b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:45.614703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1076/2165] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:45 2022] DELETE /identity/v3/users/01be647b32424cd3b92b24cc55b306b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:45.616896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1090/2166] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:45.619747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.620106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.620458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.653682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:45.655240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.743775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1077/2167] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:45.753750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:45.755245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:45.766477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc78e-321e-4190-a51b-73d3875818f2 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:45.820950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:45.831394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:45.832038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:45.832465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:45.832816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:45.847079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:45.848761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99744a-5582-4b45-b1b9-34bf543522c3 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:45.860053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1091/2168] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:46.213496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.215557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:46.233183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcaa6b-c121-4a90-b062-8ca3100b1bee None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.245225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:46.246676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.247691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.248396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] PATH_INFO: `/v3/projects/f0d5262d3aac4209b41156448d78e1b7` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.250863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d5262d3aac4209b41156448d78e1b7)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:46.253588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:46.317524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d5262d3aac4209b41156448d78e1b7', 'request_id': 'req-4fc88d1e-7c96-4127-8450-831c28076869'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.346700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d5262d3aac4209b41156448d78e1b7', 'request_id': 'req-4fc88d1e-7c96-4127-8450-831c28076869'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.358004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d5262d3aac4209b41156448d78e1b7', 'request_id': 'req-4fc88d1e-7c96-4127-8450-831c28076869'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.371574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] The token cache is being invalidate because project f0d5262d3aac4209b41156448d78e1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:46.371868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.372543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4fc88d1e-7c96-4127-8450-831c28076869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.374422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1078/2169] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:46 2022] DELETE /identity/v3/projects/f0d5262d3aac4209b41156448d78e1b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:46.379354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.379647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.380503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.418132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:46.419888 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:46.517664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1092/2170] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:46.530263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.530786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.531086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.561147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:46.562481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:46.574502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1079/2171] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:12:46.585913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.597093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1200e4d-6aed-4718-9779-b418c5b97100 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.602556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:46.603681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.605837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.605837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.605837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:46.605837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:46.607464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:46.628958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1093/2172] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:46.633393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.646717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c0df-3c63-48f7-9543-1573b5cfdf59 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.656384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:46.657038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.657446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.657848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.658842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:46.661716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:46.697393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1080/2173] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:46 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:46.698692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.712326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e71be-f90f-4cb1-abc3-2f98a675d63c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.817003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.818943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:46.835235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:46.836092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.836386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.836898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.837513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:46.839384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847e504-900f-49c1-8168-ba1683b82b61 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.839862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:46.845850 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:46.846886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:46.847524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:46.847943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] PATH_INFO: `/v3/projects/132fb3569b1549d3846e55632674a39b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:46.849543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=132fb3569b1549d3846e55632674a39b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:46.851790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:46.892073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1094/2174] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:46 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:46.897031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:46.910606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:46.951783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5453e-15b1-4ede-880d-2806301abadc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:46.954178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132fb3569b1549d3846e55632674a39b', 'request_id': 'req-8e3df855-fa57-422b-b05b-5bb239bde5ef'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.967844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132fb3569b1549d3846e55632674a39b', 'request_id': 'req-8e3df855-fa57-422b-b05b-5bb239bde5ef'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:46.982843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132fb3569b1549d3846e55632674a39b', 'request_id': 'req-8e3df855-fa57-422b-b05b-5bb239bde5ef'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.014326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] The token cache is being invalidate because project 132fb3569b1549d3846e55632674a39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:47.015282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.016359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.020527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1081/2175] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:46 2022] DELETE /identity/v3/projects/132fb3569b1549d3846e55632674a39b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:47.026915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:47.028435 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:47.159462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:47.160483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:47.160917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:47.161381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:47.162322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:47.166573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:47.170654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:47.172265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df855-fa57-422b-b05b-5bb239bde5ef admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:47.180622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:47.181375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:47.181662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:47.181942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] PATH_INFO: `/v3/users/717342579a9f45d2897a0fd485792f7e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:47.183357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717342579a9f45d2897a0fd485792f7e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:47.184877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1095/2176] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:47.186160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:47.191155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:47.194679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:47.233707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0be3-2f21-485d-aaec-327d3e136573 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:47.249923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:47.251463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:47.251463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:47.251746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:47.253127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:47.265381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:47.279547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717342579a9f45d2897a0fd485792f7e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.283157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1096/2177] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:47.287430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:47.295332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717342579a9f45d2897a0fd485792f7e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.341878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717342579a9f45d2897a0fd485792f7e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.345932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf56ab-9fb6-4086-a682-97ea2b8a5f94 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:47.355793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:47.356722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717342579a9f45d2897a0fd485792f7e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.357450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b2088e78-a016-469e-b2dc-38c40a272176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717342579a9f45d2897a0fd485792f7e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:47.357726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:47.358246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:47.358768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] PATH_INFO: `/v3/projects/302f27d436b348d5ba8e8e6f19b82528/users/56b6dfbe4b3249b980e1eaea2ded1597/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:47.372386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1082/2178] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:47 2022] DELETE /identity/v3/users/717342579a9f45d2897a0fd485792f7e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:47.453061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302f27d436b348d5ba8e8e6f19b82528, user_id=56b6dfbe4b3249b980e1eaea2ded1597, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:47.455819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:47.492843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1097/2179] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:47 2022] PUT /identity/v3/projects/302f27d436b348d5ba8e8e6f19b82528/users/56b6dfbe4b3249b980e1eaea2ded1597/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:47.505778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:47.507226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:47.509219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:47.626568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] MFA Rules not processed for user `56b6dfbe4b3249b980e1eaea2ded1597`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:47.630556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:47.686315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:47.859390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1083/2180] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:47.869142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:47.872215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.001760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:48.003571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.061174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791e467-7de5-4eed-b2d1-c8947dff5fe0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.069711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.071054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.072279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.072985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.090757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.093628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:48.105582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1098/2181] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:48.136576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:48.138521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.155320 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e740-5aeb-4d68-bff5-ec7282268f76 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.161326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71ca9-6d9f-4735-bcb9-8806846ada01 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.167105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.167889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.168273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.168530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] PATH_INFO: `/v3/users/56b6dfbe4b3249b980e1eaea2ded1597` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.175659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b6dfbe4b3249b980e1eaea2ded1597)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.178702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:48.182740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.183672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.184079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.185126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] PATH_INFO: `/v3/projects/b011584e829145e7961101ca06249d2d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.187062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b011584e829145e7961101ca06249d2d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.194538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:48.278531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b011584e829145e7961101ca06249d2d', 'request_id': 'req-e2bb4601-5124-455d-a4b7-df799ecffa32'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.288462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b011584e829145e7961101ca06249d2d', 'request_id': 'req-e2bb4601-5124-455d-a4b7-df799ecffa32'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.296907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b6dfbe4b3249b980e1eaea2ded1597'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.299671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b011584e829145e7961101ca06249d2d', 'request_id': 'req-e2bb4601-5124-455d-a4b7-df799ecffa32'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.300012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b6dfbe4b3249b980e1eaea2ded1597'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.321918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] The token cache is being invalidate because project b011584e829145e7961101ca06249d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:48.322616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.323775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e2bb4601-5124-455d-a4b7-df799ecffa32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.328851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1084/2182] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:48 2022] DELETE /identity/v3/projects/b011584e829145e7961101ca06249d2d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:48.334800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968032d-d2ea-4ec3-8ea8-f51bcf04847b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.335248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968032d-d2ea-4ec3-8ea8-f51bcf04847b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.335679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968032d-d2ea-4ec3-8ea8-f51bcf04847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.353658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b6dfbe4b3249b980e1eaea2ded1597'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.373543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b6dfbe4b3249b980e1eaea2ded1597'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.373994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5968032d-d2ea-4ec3-8ea8-f51bcf04847b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:48.375844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5968032d-d2ea-4ec3-8ea8-f51bcf04847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.380024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-355bc650-b6d6-4ebe-ad9f-44e3bff92545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b6dfbe4b3249b980e1eaea2ded1597'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:48.435277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1099/2183] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:12:48 2022] DELETE /identity/v3/users/56b6dfbe4b3249b980e1eaea2ded1597 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:48.448344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.448654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.448947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.493099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:48.495488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.527372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:48.552520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1085/2184] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:48.562625 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.563068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.564407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.589497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:48.592463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.610154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:48.689987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1100/2185] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:48.699715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:48.701762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:48.760405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1086/2186] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:48.766388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:48.810563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc42561-70f0-4ac3-86f3-2b20332c85b7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.829919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.831808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.832602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.834256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.836008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:48.838168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.841951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:48.844246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f09d-f922-4eee-8919-cb81eb9c02bd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.858190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.860564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.860564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.860564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.883389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.887026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:48.897877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1087/2187] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:48.903665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:48.924391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1101/2188] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:48.930371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b361a0-12a0-4f51-8969-ace1a1cec8c9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:48.954599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:48.954599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:48.954599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:48.954599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:48.955020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:48.956252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.032394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1088/2189] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:49.039338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.069391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301b29-4b2a-43ff-a516-b8002ad35034 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.215534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.218794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.218794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.218794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.218794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.219898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.249258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1102/2190] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:49 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:12:49.253206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.264870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d298178-665d-439e-9274-392b227d2672 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.272427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.272427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.272427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.272427 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.273611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.275335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.307641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1089/2191] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:49.309148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.320715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7052a-08af-4a85-a1c3-38615120bc02 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.330319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.331264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.331706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.332136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.333041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.339513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff80d6-78a6-4e89-ae45-c37ac7d11517 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.380910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1103/2192] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:49.381328 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.398730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970687d8-5252-4c5d-b33b-a8021a0919f3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.411664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.411664 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.412116 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.412371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] PATH_INFO: `/v3/projects/000d7f26c700420b9208380c6cd3e50d/users/d464bb7dcd8342508fd8738c67f29a22/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.434951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000d7f26c700420b9208380c6cd3e50d, user_id=d464bb7dcd8342508fd8738c67f29a22, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.438561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.460004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1090/2193] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:49 2022] PUT /identity/v3/projects/000d7f26c700420b9208380c6cd3e50d/users/d464bb7dcd8342508fd8738c67f29a22/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:49.471660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.471913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.472208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.513601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] MFA Rules not processed for user `d464bb7dcd8342508fd8738c67f29a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:49.514885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:49.640728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:49.687136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1104/2194] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:49.691364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.754084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.755733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:49.835642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c7d-431b-42c5-a103-047b9a5208c9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.843360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.844067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.844431 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.844881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.846037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.850148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.876191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c56c1-e194-4b28-892b-b1a8d23b42a7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:49.881885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:49.882690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:49.883044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:49.883399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] PATH_INFO: `/v3/projects/302f27d436b348d5ba8e8e6f19b82528` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:49.886105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=302f27d436b348d5ba8e8e6f19b82528)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:49.888469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:49.943521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1091/2195] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:49.945336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:49.961305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:49.997595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302f27d436b348d5ba8e8e6f19b82528', 'request_id': 'req-6192269a-198d-4963-9e15-e4a760137f7e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:50.015650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302f27d436b348d5ba8e8e6f19b82528', 'request_id': 'req-6192269a-198d-4963-9e15-e4a760137f7e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:50.034198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302f27d436b348d5ba8e8e6f19b82528', 'request_id': 'req-6192269a-198d-4963-9e15-e4a760137f7e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:50.058812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] The token cache is being invalidate because project 302f27d436b348d5ba8e8e6f19b82528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:12:50.059485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:50.060255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6192269a-198d-4963-9e15-e4a760137f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:12:50.066768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1105/2196] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:12:49 2022] DELETE /identity/v3/projects/302f27d436b348d5ba8e8e6f19b82528 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:50.068524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20a5f-d2e6-48f6-8bdb-20f1cec2647b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.068682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20a5f-d2e6-48f6-8bdb-20f1cec2647b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.068862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2fd9-e7ee-4f9d-b7c1-aa080ca4e3b1 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.069022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a20a5f-d2e6-48f6-8bdb-20f1cec2647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.096297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-62a20a5f-d2e6-48f6-8bdb-20f1cec2647b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:50.099331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-62a20a5f-d2e6-48f6-8bdb-20f1cec2647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:50.207411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1106/2197] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:50.216752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.217177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.217330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.240840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:50.242076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:50.251208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.251964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.252254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.253228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.253228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.255930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1107/2198] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:50.257088 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.260041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.281093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52ce0-ba6b-4bd2-8b85-4a8ccaa6c2c9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.292208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.292863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.293157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.293435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.294163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:12:50.294521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.296167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.308579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:50.318243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1108/2199] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:12:50.319234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.321236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1092/2200] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:49 2022] POST /identity/v3/users => generated 298 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:50.326378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.332171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:50.335421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780909e-e58b-429c-862a-8df618984e87 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.350920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd976b7e-96bf-47cb-8818-b3f24967220f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.360083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.360888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.361365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.361752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.362772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.365505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.370672 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.371695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.372183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.378872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.380325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.384696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.389798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1093/2201] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:50.394255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.425945 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acd74-c260-4758-ac8f-aa699c263f32 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.438815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.440049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.441315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.444937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] PATH_INFO: `/v3/projects/37071e8bf1d34623be3a8f968013fae4/users/b0cda335426e42978f9d2db9810bf199/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.463094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1109/2202] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:50 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:50.471298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.473003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37071e8bf1d34623be3a8f968013fae4, user_id=b0cda335426e42978f9d2db9810bf199, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.482884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.508057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1094/2203] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:50 2022] PUT /identity/v3/projects/37071e8bf1d34623be3a8f968013fae4/users/b0cda335426e42978f9d2db9810bf199/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:50.512620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.594679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a6b6-a78b-457b-937d-483c43157fd7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.654735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfc16b-e283-461a-8573-d0a247629b2a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.667033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.672366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.672366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.672366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.674586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.676394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.708588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1095/2204] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:50.714642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.720911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.721687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.722053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.725374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.726292 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.733838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:50.734203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.746772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debea9-11d0-4752-97fa-0a060905a4cb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.777503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.778039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.778360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.778673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] PATH_INFO: `/v3/projects/37071e8bf1d34623be3a8f968013fae4/users/b0cda335426e42978f9d2db9810bf199/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.781870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37071e8bf1d34623be3a8f968013fae4, user_id=b0cda335426e42978f9d2db9810bf199, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:50.784831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5139-41e6-4db2-9453-3970bb996f06 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:50.804741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1110/2205] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:50 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:50.810086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:50.825926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5fe8-ca33-47c6-84e5-bc0b670ed45e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:50.827619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1096/2206] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:50 2022] PUT /identity/v3/projects/37071e8bf1d34623be3a8f968013fae4/users/b0cda335426e42978f9d2db9810bf199/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:50.829195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.829497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.829786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.870283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] MFA Rules not processed for user `b0cda335426e42978f9d2db9810bf199`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:50.880728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:50.992187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:50.994570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:50.994700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:50.995094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:50.997950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.002464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:51.043197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1111/2207] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:51.049668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:51.071556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aa2b-6371-40a8-aca1-2d9dd32fa6bf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:51.091074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:51.091801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.092087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.092417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.093177 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.095871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:51.106205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:51.122660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1097/2208] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:51.122660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:51.122929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1112/2209] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:51.130294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:51.133400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:51.152009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ad47a-c315-4af8-b1e2-9c7648e978a1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:51.165713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:51.166467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.166759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.167039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] PATH_INFO: `/v3/projects/ace1eeda755942f2b9747c4ca4ba27b1/users/740e5f20028043cd802104587a66369c/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.207631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace1eeda755942f2b9747c4ca4ba27b1, user_id=740e5f20028043cd802104587a66369c, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.219921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0969-93d7-427a-8076-d9b5fb3e2f50 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:51.259168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1098/2210] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:51 2022] PUT /identity/v3/projects/ace1eeda755942f2b9747c4ca4ba27b1/users/740e5f20028043cd802104587a66369c/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:51.295138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ac41d-d4ff-4ee6-91bb-f240404880c3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:51.341980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.342591 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.343561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.440457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:51.441374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.441785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.442153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.453975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:51.456379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] MFA Rules not processed for user `740e5f20028043cd802104587a66369c`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:51.460186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:51.563761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.566212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:51.581858 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1113/2211] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:51.602377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1099/2212] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:51.602838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:51.750898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2313e49-8aa4-4ea6-a130-f96f08233a53 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:51.759983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:51.760937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.761236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.762236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.763046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.765863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:51.795838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:51.819782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:51.829871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1114/2213] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:51 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:51.833345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5924-93ce-4f2a-bb02-f5835f75aad6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:51.925641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:51.975818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:51.976787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:51.977290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:51.977499 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:51.978575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:51.980801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.018483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1100/2214] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:51 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:52.022765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.037613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc1545-66b4-47b7-a36e-8a069a956bc1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.044640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.046346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.046772 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.047410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.049009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.051061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.072284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1115/2215] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:52.076700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.090680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b3409-c2c1-43c1-b86e-5b11ef02f9e6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.097417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.098428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.098863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.099226 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.100090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.107061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e608b-76ba-4606-90f0-b4c485616fd2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.133948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1101/2216] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:52.139087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.155949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cca70-d5dc-4416-8ec5-f8d28d1f9d2d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.163757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.164460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.164750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.165677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] PATH_INFO: `/v3/projects/b3b6e25dd73b4b469510fde5df50f822/users/f6345e052e424700bbc1eb67fc34f9da/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.191755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b6e25dd73b4b469510fde5df50f822, user_id=f6345e052e424700bbc1eb67fc34f9da, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.195417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e210e-d25b-457c-b683-78adf5aa122e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.236863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1116/2217] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:52 2022] PUT /identity/v3/projects/b3b6e25dd73b4b469510fde5df50f822/users/f6345e052e424700bbc1eb67fc34f9da/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:52.252280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.252953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.253450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.261698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.263628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.264958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.323021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] MFA Rules not processed for user `f6345e052e424700bbc1eb67fc34f9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:52.323128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] MFA Rules not processed for user `023c699e0cac426f8e7229ebbb7727b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:52.324088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:52.325840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:52.487775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1102/2218] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:52.496862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.514269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1117/2219] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:52.537236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.545368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:52.651650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382facab-148a-4c68-9f5b-4bc56d5f385c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.661288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.661973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.663144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.663144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.663456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.672311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.743996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc308-ec52-4f96-b9d6-651590218743 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.754476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.754476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.754476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.754476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.768187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.769895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1103/2220] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:12:52 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:52.770067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.776682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.783638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1118/2221] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:52.834855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:52.879193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3de09-4ac3-4313-90ef-fee52cd93764 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.890208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.891069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.891464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.891842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.893175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.895337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.927787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1104/2222] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:12:52 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:12:52.933214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.946206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9125a-bb14-4794-be53-2398a3feabf6 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.952379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.953534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.953534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.953732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:52.954664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:52.956544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:52.970017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1119/2223] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:12:52.975020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:52.987277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127352f-2693-4309-bdb6-8ca555206e2f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:52.996931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:52.997640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:52.997931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:52.998211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] PATH_INFO: `/v3/projects/54beeb5aa79d441dae0f4837190d95f2/users/c6e7846388c04793aca47d3821ff4437/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:53.018337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54beeb5aa79d441dae0f4837190d95f2, user_id=c6e7846388c04793aca47d3821ff4437, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:53.021938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:53.044268 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1105/2224] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:52 2022] PUT /identity/v3/projects/54beeb5aa79d441dae0f4837190d95f2/users/c6e7846388c04793aca47d3821ff4437/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:12:53.050905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:53.066550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66694-d47f-4bd2-8472-e851d2d70dbc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:53.124773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:53.187813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:53.188472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:53.188753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:53.189041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:53.189766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:53.191646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23a892-cab3-45d8-b34e-fcbf1c681b5e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:53.204744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1120/2225] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:12:53.209235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:53.220825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb40d-9a1e-403a-b611-c727a03776e7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:53.229459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:53.230315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:53.230705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:53.231067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] PATH_INFO: `/v3/projects/54beeb5aa79d441dae0f4837190d95f2/users/c6e7846388c04793aca47d3821ff4437/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:53.233311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54beeb5aa79d441dae0f4837190d95f2, user_id=c6e7846388c04793aca47d3821ff4437, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:53.236514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:53.257994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1106/2226] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:12:53 2022] PUT /identity/v3/projects/54beeb5aa79d441dae0f4837190d95f2/users/c6e7846388c04793aca47d3821ff4437/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:12:53.273277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc59d-a41f-42c1-93d4-c0f2ef4d11a7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:53.279477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc59d-a41f-42c1-93d4-c0f2ef4d11a7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:53.280159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc59d-a41f-42c1-93d4-c0f2ef4d11a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:53.338082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9ddfc59d-a41f-42c1-93d4-c0f2ef4d11a7 None None] MFA Rules not processed for user `c6e7846388c04793aca47d3821ff4437`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:53.339566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9ddfc59d-a41f-42c1-93d4-c0f2ef4d11a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:53.532343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1121/2227] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:53.612108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:53.761117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32bc3-72de-4881-bea3-71453b951960 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:53.766111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:53.766997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:53.768124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:53.768588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:53.882992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:53.885493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:53.924184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1107/2228] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:55.366001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:55.366909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:55.366909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:55.395278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] MFA Rules not processed for user `023c699e0cac426f8e7229ebbb7727b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:12:55.396709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:55.524020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1122/2229] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:12:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:12:56.286931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:56.289290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:12:56.310740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ad95-fb9c-4e50-b051-97b956246be6 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:56.318904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:56.319936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:56.320448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:56.320956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:56.397930 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:56.424935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:56.426475 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:56.458799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1108/2230] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:12:57.183878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:57.196265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3cf8-7add-46f8-a9b5-9e20baeb31ae None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:57.201323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:57.202542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:57.203328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:57.203506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:57.304504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:57.330799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:57.332451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:57.345797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1123/2231] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:12:57.889084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:12:57.902908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cdbe4-f6bf-4389-96fd-6e7c2154c943 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:12:57.920927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:12:57.921978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:12:57.922380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:12:57.922864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:12:57.940693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:12:57.942411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8cf2d-f355-482b-9093-93b4245444d6 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:12:57.965896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1109/2232] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:03.766420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:03.768568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:03.849955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad331ade-f8cd-4f7d-80bb-4ae1659a4049 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:03.855051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:03.855716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:03.856018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:03.856322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] PATH_INFO: `/v3/users/9b7603f7bf9042a38e03fa53db41230a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:03.857534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7603f7bf9042a38e03fa53db41230a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:03.859525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:03.914902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7603f7bf9042a38e03fa53db41230a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:03.915625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7603f7bf9042a38e03fa53db41230a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:03.939079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7603f7bf9042a38e03fa53db41230a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:03.956963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7603f7bf9042a38e03fa53db41230a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:03.958402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7603f7bf9042a38e03fa53db41230a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:03.978557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1124/2233] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:03 2022] DELETE /identity/v3/users/9b7603f7bf9042a38e03fa53db41230a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:03.984848 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:03.986639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:03.986941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.026137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:04.029026 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:04.143793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1110/2234] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:04.157616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:04.159960 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:04.245814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed803-108c-4f75-bf4e-277b78955c1a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:04.252073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:04.252663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:04.252952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:04.253259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.263997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:04.265453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291543b-8d21-4a88-b304-dea67108fc1e service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:04.276777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1125/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:04.691902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:04.693540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:04.706727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d91ec-85e8-475f-ac5d-d9971a181b9e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:04.713758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:04.714513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:04.714804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:04.715085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] PATH_INFO: `/v3/projects/22f2f6a4d9824095bbd4a38a9e7a966f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.716343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f2f6a4d9824095bbd4a38a9e7a966f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:04.718882 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:04.776008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2f6a4d9824095bbd4a38a9e7a966f', 'request_id': 'req-777c0a59-2ce3-40fa-b597-da62aa9db87d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:04.785141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2f6a4d9824095bbd4a38a9e7a966f', 'request_id': 'req-777c0a59-2ce3-40fa-b597-da62aa9db87d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:04.791829 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2f6a4d9824095bbd4a38a9e7a966f', 'request_id': 'req-777c0a59-2ce3-40fa-b597-da62aa9db87d'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:04.803724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] The token cache is being invalidate because project 22f2f6a4d9824095bbd4a38a9e7a966f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:04.804023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:04.804698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-777c0a59-2ce3-40fa-b597-da62aa9db87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:04.806252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1111/2236] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:04 2022] DELETE /identity/v3/projects/22f2f6a4d9824095bbd4a38a9e7a966f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:04.811332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:04.811810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:04.811995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.833407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:04.840556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:04.842839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:04.920299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1126/2237] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:04.922091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:04.922392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:04.922727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.943239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:04.944587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:04.953538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1112/2238] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:04.957873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:04.968385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606670a-ecc6-47b1-8d72-23097e3a76b0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:04.973075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:04.973704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:04.973990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:04.974268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:04.975001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:04.975811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:04.977036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:04.989448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1127/2239] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:13:04.994117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.003613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851ff55-f483-4e7f-bd8b-370e40dc9b2b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.008282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.009441 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.009725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.010052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.010805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.012709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.052036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1113/2240] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:04 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:05.056070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.068622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758769-6ab0-4dc9-a2de-6346e4950ed6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.131550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.132243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.132537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.132819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.134172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.136288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.160455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1128/2241] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:05 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:05.166165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.177289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c44ed-bea0-4fd5-888a-b5c360fa3afd admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.182890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.183553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.183870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.184159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.184875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.186588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.198223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1114/2242] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:05.203717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.215794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94eaa-6ec0-4770-9d83-a7fba3beccb4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.221717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.222722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.223153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.223595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.224805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.227079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7b92-117f-4583-80c5-074e995adc10 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.245176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1129/2243] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:13:05.251504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.269080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e465f09-9edc-41ce-9547-7dc185033b46 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.277083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.278218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.278717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.279180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] PATH_INFO: `/v3/projects/f294e2f0251541cc9c7aaa2ab4ca0ec0/users/a523488b793c4e26b3b7039e8f5111e5/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.285125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:05.316790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f294e2f0251541cc9c7aaa2ab4ca0ec0, user_id=a523488b793c4e26b3b7039e8f5111e5, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.324168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.350351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1115/2244] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:05 2022] PUT /identity/v3/projects/f294e2f0251541cc9c7aaa2ab4ca0ec0/users/a523488b793c4e26b3b7039e8f5111e5/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:05.371777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.372066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.372350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.413799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] MFA Rules not processed for user `a523488b793c4e26b3b7039e8f5111e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:05.415289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:05.493470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1130/2245] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:13:05.504296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.506651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:05.542773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:05.544769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:05.551543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:05.620704 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3e21-9c8b-4753-9c6a-6cb257f58f0f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.626106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.626938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.627935 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.628455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.650699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.652279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4eda7-f2f8-4e5e-a620-ee806fcd89b2 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.666646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37e6f-f04f-4266-addd-dc9caa51722d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:05.668111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1116/2246] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:05.689742 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:05.690592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.690884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.691167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] PATH_INFO: `/v3/users/740e5f20028043cd802104587a66369c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.694314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740e5f20028043cd802104587a66369c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:05.698054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:05.798153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740e5f20028043cd802104587a66369c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:05.799071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740e5f20028043cd802104587a66369c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:05.817640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740e5f20028043cd802104587a66369c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:05.827969 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740e5f20028043cd802104587a66369c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:05.829775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740e5f20028043cd802104587a66369c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:05.853383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1131/2247] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:05 2022] DELETE /identity/v3/users/740e5f20028043cd802104587a66369c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:05.857946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:05.858743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:05.859034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:05.901064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:05.902862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.002890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1117/2248] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:13:06.012763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.014398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.150814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5a48-0c78-47c2-809a-12b70f9c4517 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.162767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.164312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.173695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.175141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.175636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.176164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.187011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea913e6-cfaa-402b-b50b-a7fe0d9868a1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.200751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.202482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.203000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.204073 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] PATH_INFO: `/v3/users/d464bb7dcd8342508fd8738c67f29a22` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.206101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d464bb7dcd8342508fd8738c67f29a22)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.206251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.208291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a6848-1eb4-4696-992a-a1b4faf69a4c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:06.217398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:06.233666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1132/2249] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:06.340321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd464bb7dcd8342508fd8738c67f29a22'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.353489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd464bb7dcd8342508fd8738c67f29a22'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.397454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd464bb7dcd8342508fd8738c67f29a22'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.416917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd464bb7dcd8342508fd8738c67f29a22'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.417787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd464bb7dcd8342508fd8738c67f29a22'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.423061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:06.442219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1118/2250] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:06 2022] DELETE /identity/v3/users/d464bb7dcd8342508fd8738c67f29a22 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:06.447409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.447698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.447974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.494581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:06.496126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.523310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:06.592282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1133/2251] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:06.606133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.607758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.675534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fbdef-5dac-4418-8658-77549fe2f8fb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.679221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.679904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.680258 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.681069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.692172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.693964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:06.705498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1119/2252] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:06.725850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.727562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.742470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34fbd-ed1d-4fba-befa-009bf5fb7626 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.760905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.761602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.761919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.762204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] PATH_INFO: `/v3/projects/ace1eeda755942f2b9747c4ca4ba27b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.764174 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace1eeda755942f2b9747c4ca4ba27b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.766157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:06.833045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.835101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace1eeda755942f2b9747c4ca4ba27b1', 'request_id': 'req-3949382c-966c-4d00-a442-6036f367d205'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.835786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.843040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace1eeda755942f2b9747c4ca4ba27b1', 'request_id': 'req-3949382c-966c-4d00-a442-6036f367d205'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.849985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4410eb-3a9e-4476-9ed1-2f78f5f87c17 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.850500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace1eeda755942f2b9747c4ca4ba27b1', 'request_id': 'req-3949382c-966c-4d00-a442-6036f367d205'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.867734 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] The token cache is being invalidate because project ace1eeda755942f2b9747c4ca4ba27b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:06.868615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.869587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:06.871555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1134/2253] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:06 2022] DELETE /identity/v3/projects/ace1eeda755942f2b9747c4ca4ba27b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:06.875830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:06.877767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:06.931156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.932267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.932838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.933571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] PATH_INFO: `/v3/users/60152fc729584c28a2db6fb6cca2d89c` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.935538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60152fc729584c28a2db6fb6cca2d89c)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.939077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:06.980559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949382c-966c-4d00-a442-6036f367d205 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:06.985686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:06.986421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:06.986792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:06.987138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] PATH_INFO: `/v3/users/f6345e052e424700bbc1eb67fc34f9da` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:06.988410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6345e052e424700bbc1eb67fc34f9da)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:06.990328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.010947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60152fc729584c28a2db6fb6cca2d89c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.019601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60152fc729584c28a2db6fb6cca2d89c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.036023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60152fc729584c28a2db6fb6cca2d89c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.048739 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60152fc729584c28a2db6fb6cca2d89c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.049442 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60152fc729584c28a2db6fb6cca2d89c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.057610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1120/2254] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:06 2022] DELETE /identity/v3/users/60152fc729584c28a2db6fb6cca2d89c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:07.059842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:07.061824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.067093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6345e052e424700bbc1eb67fc34f9da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.067801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6345e052e424700bbc1eb67fc34f9da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.070962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.084570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6345e052e424700bbc1eb67fc34f9da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.092080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6345e052e424700bbc1eb67fc34f9da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.092847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f422b80-f782-4f75-8269-28cfa1327386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6345e052e424700bbc1eb67fc34f9da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.093719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.115964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1135/2255] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:06 2022] DELETE /identity/v3/users/f6345e052e424700bbc1eb67fc34f9da => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:07.117634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.118538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.118827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.140298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:07.140862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d683-1a5f-4b9d-b155-d151a54be817 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:07.142169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.206672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:07.207336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.207618 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.207901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] PATH_INFO: `/v3/projects/000d7f26c700420b9208380c6cd3e50d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.209229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000d7f26c700420b9208380c6cd3e50d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:07.211366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.240525 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1136/2256] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:07.254848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:07.258586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.285687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000d7f26c700420b9208380c6cd3e50d', 'request_id': 'req-c8fd3b52-01f5-436d-92e3-4edb6260b382'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.304580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000d7f26c700420b9208380c6cd3e50d', 'request_id': 'req-c8fd3b52-01f5-436d-92e3-4edb6260b382'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.316960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000d7f26c700420b9208380c6cd3e50d', 'request_id': 'req-c8fd3b52-01f5-436d-92e3-4edb6260b382'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.341652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] The token cache is being invalidate because project 000d7f26c700420b9208380c6cd3e50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:07.342860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.344460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.347855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd055e-3fd0-4385-aaec-3d895d3dd35f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:07.351113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1121/2257] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:07 2022] DELETE /identity/v3/projects/000d7f26c700420b9208380c6cd3e50d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:07.353076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:07.355905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.430307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:07.431428 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.431859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.432280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.435117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.482267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3b52-01f5-436d-92e3-4edb6260b382 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:07.488928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:07.489718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.490205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.490526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] PATH_INFO: `/v3/users/b0cda335426e42978f9d2db9810bf199` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.492004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cda335426e42978f9d2db9810bf199)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:07.494293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.496181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.513786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.550250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:07.551958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.563463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1137/2258] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:07.564482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:07.565974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.581660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5615d-d287-4c50-91c3-5486d1b829a2 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:07.588769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:07.591085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.591379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.591604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cda335426e42978f9d2db9810bf199'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.591778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] PATH_INFO: `/v3/projects/b3b6e25dd73b4b469510fde5df50f822` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.594124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b6e25dd73b4b469510fde5df50f822)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:07.597790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.618323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cda335426e42978f9d2db9810bf199'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.658646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cda335426e42978f9d2db9810bf199'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.672106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cda335426e42978f9d2db9810bf199'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.672941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cda335426e42978f9d2db9810bf199'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.695774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1122/2259] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:07 2022] DELETE /identity/v3/users/b0cda335426e42978f9d2db9810bf199 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:07.697158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b6e25dd73b4b469510fde5df50f822', 'request_id': 'req-44a32bba-bf3b-4903-afdf-fe379153b81e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.705613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b6e25dd73b4b469510fde5df50f822', 'request_id': 'req-44a32bba-bf3b-4903-afdf-fe379153b81e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.717777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b6e25dd73b4b469510fde5df50f822', 'request_id': 'req-44a32bba-bf3b-4903-afdf-fe379153b81e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.754681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] The token cache is being invalidate because project b3b6e25dd73b4b469510fde5df50f822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:07.755094 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.755994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:07.757961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1138/2260] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:07 2022] DELETE /identity/v3/projects/b3b6e25dd73b4b469510fde5df50f822 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:07.762105 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:07.763789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:07.894345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55d69-51c4-44e6-9ea7-554380e4921b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:07.901169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:07.902230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:07.902772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:07.903217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] PATH_INFO: `/v3/users/c6e7846388c04793aca47d3821ff4437` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:07.904661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e7846388c04793aca47d3821ff4437)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:07.908009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:07.993712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e7846388c04793aca47d3821ff4437'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.002745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e7846388c04793aca47d3821ff4437'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.021278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e7846388c04793aca47d3821ff4437'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.059048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e7846388c04793aca47d3821ff4437'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.062130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e7846388c04793aca47d3821ff4437'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.065185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:08.089834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1123/2261] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:07 2022] DELETE /identity/v3/users/c6e7846388c04793aca47d3821ff4437 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:08.238029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.242622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.245767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.246456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.352123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af526875-c3a8-4e8e-b9b2-0f3a0a210ffa admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.358582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.359264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.359745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.359900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] PATH_INFO: `/v3/projects/e11aac632f45420e9507dc4b96898387` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.362128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11aac632f45420e9507dc4b96898387)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.364432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.371966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a32bba-bf3b-4903-afdf-fe379153b81e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.381414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.382771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.383507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.384456 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] PATH_INFO: `/v3/projects/37071e8bf1d34623be3a8f968013fae4` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.386478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=37071e8bf1d34623be3a8f968013fae4)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.387980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.445086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11aac632f45420e9507dc4b96898387', 'request_id': 'req-6e902f0c-87f6-46ed-bea1-e8d892a76670'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.450164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37071e8bf1d34623be3a8f968013fae4', 'request_id': 'req-3db83384-b25a-4f02-958e-0ed327098fbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.464003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11aac632f45420e9507dc4b96898387', 'request_id': 'req-6e902f0c-87f6-46ed-bea1-e8d892a76670'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.469407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37071e8bf1d34623be3a8f968013fae4', 'request_id': 'req-3db83384-b25a-4f02-958e-0ed327098fbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.471455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:08.475370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11aac632f45420e9507dc4b96898387', 'request_id': 'req-6e902f0c-87f6-46ed-bea1-e8d892a76670'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.489934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37071e8bf1d34623be3a8f968013fae4', 'request_id': 'req-3db83384-b25a-4f02-958e-0ed327098fbe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.496802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] The token cache is being invalidate because project e11aac632f45420e9507dc4b96898387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:08.497112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.498017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.502525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1124/2262] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:08 2022] DELETE /identity/v3/projects/e11aac632f45420e9507dc4b96898387 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:08.504077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.505701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.507138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] The token cache is being invalidate because project 37071e8bf1d34623be3a8f968013fae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:08.507707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.509129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3db83384-b25a-4f02-958e-0ed327098fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.512204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1139/2263] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:08 2022] DELETE /identity/v3/projects/37071e8bf1d34623be3a8f968013fae4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:08.515768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505ec2-2122-4889-b88f-2082c1c89629 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.516057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505ec2-2122-4889-b88f-2082c1c89629 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.516774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505ec2-2122-4889-b88f-2082c1c89629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.548631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2b505ec2-2122-4889-b88f-2082c1c89629 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.550792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2b505ec2-2122-4889-b88f-2082c1c89629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.588827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902f0c-87f6-46ed-bea1-e8d892a76670 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.627806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:08.629611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1140/2264] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.631552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec8bf-0232-4fab-9582-1d22404ad322 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.632264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec8bf-0232-4fab-9582-1d22404ad322 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.632817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec8bf-0232-4fab-9582-1d22404ad322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.653932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-153ec8bf-0232-4fab-9582-1d22404ad322 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.655189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-153ec8bf-0232-4fab-9582-1d22404ad322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.659430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.660230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.660520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.660806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] PATH_INFO: `/v3/projects/54beeb5aa79d441dae0f4837190d95f2` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.661968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54beeb5aa79d441dae0f4837190d95f2)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.663963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.673040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1141/2265] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.673040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51016-d171-4910-849f-ef342a9b7602 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.673040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51016-d171-4910-849f-ef342a9b7602 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.673040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a51016-d171-4910-849f-ef342a9b7602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.690280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a2a51016-d171-4910-849f-ef342a9b7602 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.691539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a2a51016-d171-4910-849f-ef342a9b7602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.699714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1142/2266] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.700941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51efb8-2582-47d1-8d84-1d789d3edc77 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.701229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51efb8-2582-47d1-8d84-1d789d3edc77 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.701508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51efb8-2582-47d1-8d84-1d789d3edc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.720918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6a51efb8-2582-47d1-8d84-1d789d3edc77 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.722119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6a51efb8-2582-47d1-8d84-1d789d3edc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.729731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54beeb5aa79d441dae0f4837190d95f2', 'request_id': 'req-5c43fb76-1835-4d63-a986-8a54940ec12e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.738220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54beeb5aa79d441dae0f4837190d95f2', 'request_id': 'req-5c43fb76-1835-4d63-a986-8a54940ec12e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.744711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54beeb5aa79d441dae0f4837190d95f2', 'request_id': 'req-5c43fb76-1835-4d63-a986-8a54940ec12e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.758715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] The token cache is being invalidate because project 54beeb5aa79d441dae0f4837190d95f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:08.759018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.759736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:08.761308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1125/2267] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:08 2022] DELETE /identity/v3/projects/54beeb5aa79d441dae0f4837190d95f2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:08.764583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.764583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.796731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1143/2268] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.798117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.798403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.798713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.821991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.823538 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.834158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1144/2269] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.835318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.846860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d84403-cede-4f21-9b12-120bfe5df8ee None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.851934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb76-1835-4d63-a986-8a54940ec12e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.852863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.853597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.853987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.854366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.855212 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:08.855603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.857353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a87-dd3a-4bf2-9a70-cbe2b378acfc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.858186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.858928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.859222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.859501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.860196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:08.860506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.862091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.870645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1145/2270] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:13:08.872072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.872435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.872783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.877658 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1126/2271] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:13:08.878456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.888248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e2cd-902f-474d-ae27-a76a7926edf7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.892522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:08.893337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.893952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.894116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:08.894242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.894563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.895239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.897211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.902545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1146/2272] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:08.903463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.912783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa000f-1621-4d47-9edc-90f0b62bb5de None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:08.918271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:08.918997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:08.919283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:08.919579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:08.920259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:08.922215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:08.930685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1127/2273] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:08.930685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.955405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1147/2274] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:08.955405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:08.974676 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:08.986282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:09.004311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3638fd-3a2b-4be5-86cd-9c65d361a709 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.026933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8103df4-97ba-4fdd-9c61-fb1f2d2625a1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.032076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.032713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.032998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.033277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.033951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.035919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.060170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1148/2275] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:08 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:09.061393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.071788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a7fc-d023-45c6-8b57-a0d2f9c0288b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.071981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.072743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.072743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.072981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.073688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:09.074002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.075842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.077166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.077795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.078081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.078361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.079158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.081117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.093607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1128/2276] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:13:09.093607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.104581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba0261-257b-44ce-9489-e9a0bec0706a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.110078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1149/2277] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:09.110078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.112782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.113414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.113702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.113981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.114787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.116389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.124045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8ee8-0bce-4a1f-adc3-1973198e548b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.127801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1129/2278] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.131446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.139121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.139886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.140273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.140664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.142752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.143937 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.144129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadff977-8ec9-45b7-9e73-dd569004f1ed admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.152289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.153305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.153799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.154285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.156315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.159146 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.174415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1130/2279] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.177950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1150/2280] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:09.177950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.179606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.192931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9389-beca-41a7-bd4b-f0c3b6e95431 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.259654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde5857-06d0-4a62-a9cb-1d8097f5f9a0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.273933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.274663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.275449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.275567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.275758 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.275850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.276274 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.276404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.276841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.277003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.278483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.278661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.291205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1151/2281] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.291936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.294652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1131/2282] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.295821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.302586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2e2d-28ba-400d-b4fb-afdcf4e0ef65 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.306700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556182-48e4-4aaa-9ed9-c883bfd53f8f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.307494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.308121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.308407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.308727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.309410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.311536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.312130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.312906 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.313304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.313681 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] PATH_INFO: `/v3/projects/d76117c390bc4d4dba1553e2cd25fdd3/users/50c354592b40428fb948c039ee780104/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.331229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76117c390bc4d4dba1553e2cd25fdd3, user_id=50c354592b40428fb948c039ee780104, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.334300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.336291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1152/2283] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:09.337809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.349121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579f1c-337e-4de4-a942-7ff26685039c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.352308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1132/2284] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:09 2022] PUT /identity/v3/projects/d76117c390bc4d4dba1553e2cd25fdd3/users/50c354592b40428fb948c039ee780104/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:09.353135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.401378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:09.413148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:09.422372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.423084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.423364 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.423637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] PATH_INFO: `/v3/projects/1a4c09dba5b24ef5b37b730b259d3790/users/5cf524f6288040219c0492d3a794e830/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.435123 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e42e2b-825b-4762-930e-840d93edf8c8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.438814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4c09dba5b24ef5b37b730b259d3790, user_id=5cf524f6288040219c0492d3a794e830, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.440249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.440876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.441164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.441446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.441537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14249-726e-4157-a556-ed69ea7266eb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.442142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.443792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.454863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1153/2285] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:09 2022] PUT /identity/v3/projects/1a4c09dba5b24ef5b37b730b259d3790/users/5cf524f6288040219c0492d3a794e830/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:09.456247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.456626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.456984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.458650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1133/2286] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.459545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.473189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8580-18f1-4513-944c-cb4d06b2dcb6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.488956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] MFA Rules not processed for user `50c354592b40428fb948c039ee780104`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:09.490361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.535549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.536081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.536368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.536650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.537352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.540267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360bb3-ce70-4602-98db-aae6d3afb493 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.553218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1134/2287] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:09.554638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.554931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.555211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.567148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1154/2288] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:09.568059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.577256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:09.579237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.581886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2933c21-871b-48a1-985b-14c4705f7c98 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.587190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.587730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1135/2289] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:09.590829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.590829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.591025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.591129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] PATH_INFO: `/v3/projects/b337069f90b24ae38e6851c10ab90a27/users/f120eb95be0b4175b3f3c0a01270b2e6/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.591218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.604576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b337069f90b24ae38e6851c10ab90a27, user_id=f120eb95be0b4175b3f3c0a01270b2e6, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.607281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.620677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1155/2290] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:09 2022] PUT /identity/v3/projects/b337069f90b24ae38e6851c10ab90a27/users/f120eb95be0b4175b3f3c0a01270b2e6/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:09.621491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.630808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.654401 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3370a-cfc1-41cd-815b-17042f4ac14c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.694980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e54c8-d402-453a-9fc2-f9e409478635 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.700562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.701261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.701546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.701823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.710582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.711230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.711588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.711874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.740265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:09.770489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:09.776336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.776700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.778244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77a4c7-f29e-4040-8df1-fd9ccd96696f service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.778523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.789657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1136/2291] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:09.789863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1156/2292] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:09.790787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.791088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.791720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.823027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] MFA Rules not processed for user `f120eb95be0b4175b3f3c0a01270b2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:09.824384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.907621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1137/2293] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:09.920281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:09.921805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:09.936636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9429d2-a7a6-407e-ae8a-33efd8a7bbff service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:09.941767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:09.942355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:09.942684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:09.942965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:09.954626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:09.956308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7285cd-0690-430e-b623-ca28aa365651 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:09.980697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1157/2294] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:14.598322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:14.640635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c6346-d2d9-4af5-9cd7-0bb82a4708b8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:14.667428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:14.668057 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:14.668344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:14.668634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] PATH_INFO: `/v3/users/50c354592b40428fb948c039ee780104` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:14.672594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c354592b40428fb948c039ee780104)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:14.674578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:14.769120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c354592b40428fb948c039ee780104'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:14.787695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c354592b40428fb948c039ee780104'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:14.811524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c354592b40428fb948c039ee780104'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:14.831828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c354592b40428fb948c039ee780104'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:14.832645 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c354592b40428fb948c039ee780104'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:14.854267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1138/2295] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:14 2022] DELETE /identity/v3/users/50c354592b40428fb948c039ee780104 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:14.866681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d19-a847-4f2f-b2c8-eb8a17dfd952 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:14.867618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d19-a847-4f2f-b2c8-eb8a17dfd952 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:14.869414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d19-a847-4f2f-b2c8-eb8a17dfd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:14.921267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c16f4d19-a847-4f2f-b2c8-eb8a17dfd952 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:14.922540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c16f4d19-a847-4f2f-b2c8-eb8a17dfd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.064479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1158/2296] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:15.080285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.081715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.151726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:15.160263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.160553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.160832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.197659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c301f-91cd-49aa-b853-56d2ee4a42e3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.212525 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.213192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.213484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.213769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.228939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] MFA Rules not processed for user `5cf524f6288040219c0492d3a794e830`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:15.228939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.235313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.238462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.254102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1139/2297] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:15.325196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1159/2298] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:15.326652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.328195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.345467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784e42-9a11-4d42-ad6f-3c813c66c3dc service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.353070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.353743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.353994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.354278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.355223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.357259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.397481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1140/2299] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:15 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:15.402293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.414075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b35d-3af4-49fa-b7a3-09d41daa51f0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.503874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.504692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.504923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.505389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.506154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.513552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.539642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:15.552996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.556281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1160/2300] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:15 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:15.573347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b382ea-c93d-4309-93be-0e4fd72b0f3b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.580195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.581242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.581814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.582364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.584114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.588303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.603092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1141/2301] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:13:15.607234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.617956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808496-f1ac-4c54-a852-7e3186b630bf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.624078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.624778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.625065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.625352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] PATH_INFO: `/v3/projects/cde7c862ecb3414ba4147e010cf00ef7/users/526a63663dcb419fb7ba0052d2baef9f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.643587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde7c862ecb3414ba4147e010cf00ef7, user_id=526a63663dcb419fb7ba0052d2baef9f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.646518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.667849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1161/2302] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:15 2022] PUT /identity/v3/projects/cde7c862ecb3414ba4147e010cf00ef7/users/526a63663dcb419fb7ba0052d2baef9f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:15.669465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.669581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.671428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.688177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da070-f809-454e-8212-c7bfbcc97d39 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.765684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b4e8-1ee2-4466-8447-0cc716e804db admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.770434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.770929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.771477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.771690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.771830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.772108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.772394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.772819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] PATH_INFO: `/v3/projects/d76117c390bc4d4dba1553e2cd25fdd3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.772944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.774421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76117c390bc4d4dba1553e2cd25fdd3)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.774680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.776727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.790775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1162/2303] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:15.793582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:15.807006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29c216-c332-4991-9c5d-93457610dcc8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:15.814268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:15.816403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.817148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.817440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] PATH_INFO: `/v3/projects/cde7c862ecb3414ba4147e010cf00ef7/users/526a63663dcb419fb7ba0052d2baef9f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.819737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde7c862ecb3414ba4147e010cf00ef7, user_id=526a63663dcb419fb7ba0052d2baef9f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:15.825464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52101b-2fb7-4c8e-8180-8a199b54868a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:15.847719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76117c390bc4d4dba1553e2cd25fdd3', 'request_id': 'req-6c4c9607-892e-492e-ac90-35f3c2847f13'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:15.850854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1163/2304] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:15 2022] PUT /identity/v3/projects/cde7c862ecb3414ba4147e010cf00ef7/users/526a63663dcb419fb7ba0052d2baef9f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:15.858477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76117c390bc4d4dba1553e2cd25fdd3', 'request_id': 'req-6c4c9607-892e-492e-ac90-35f3c2847f13'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:15.866045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76117c390bc4d4dba1553e2cd25fdd3', 'request_id': 'req-6c4c9607-892e-492e-ac90-35f3c2847f13'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:15.882678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] The token cache is being invalidate because project d76117c390bc4d4dba1553e2cd25fdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:15.883022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:15.884352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6c4c9607-892e-492e-ac90-35f3c2847f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:15.886218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1142/2305] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:15 2022] DELETE /identity/v3/projects/d76117c390bc4d4dba1553e2cd25fdd3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:15.891307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:15.891805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:15.892084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:15.914191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:15.915457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:15.993463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1164/2306] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:13:16.001132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.001438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.001748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.050767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:16.054576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:16.065230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1143/2307] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:16.069940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.094701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6faa-f59f-4a37-bb09-edfe392fa733 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.110015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.110864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.111116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.111331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.112099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:16.112936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.114124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.129383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1165/2308] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:13:16.133556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.145667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf782-af85-40c4-b94e-0655b308fa8f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.152574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.153223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.153517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.153802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.154802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.156962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.181065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:16.191407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1144/2309] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:16.195287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.207572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26f9fb-e3fc-4382-81b4-bd886ef2bf41 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.267067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:16.287889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.288831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.289311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.290187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.291055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.293353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.329595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1166/2310] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:16 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:13:16.331379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.347860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2b81-50c4-4e6e-b2d0-c32baaa6d5e4 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.355687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.356361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.356647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.356918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.358189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.370738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.383548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1145/2311] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:13:16.387336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.398487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a1273-8aa7-4cba-b98b-e224f04098f4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.404603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.405217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.405850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.405850 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.406527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.408214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf7b5-d716-4c32-879a-fa8ee4c0eb3d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.421301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1167/2312] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:16.425583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.446607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b671-f164-4302-ab45-ec2e7cf240be admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.453218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.454406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.455469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.455469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] PATH_INFO: `/v3/projects/3156a99cf94e4845b22550fe2e064849/users/55d69ed62c5742d28c1f06175a02e17f/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.474968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3156a99cf94e4845b22550fe2e064849, user_id=55d69ed62c5742d28c1f06175a02e17f, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.479068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.497988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1146/2313] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:16 2022] PUT /identity/v3/projects/3156a99cf94e4845b22550fe2e064849/users/55d69ed62c5742d28c1f06175a02e17f/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:16.504355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c1cad-92c1-43fe-bb9f-5478879c3495 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.504586 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c1cad-92c1-43fe-bb9f-5478879c3495 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.504676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c1cad-92c1-43fe-bb9f-5478879c3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.529639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6d2c1cad-92c1-43fe-bb9f-5478879c3495 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:16.530921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6d2c1cad-92c1-43fe-bb9f-5478879c3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:16.640929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1168/2314] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:16.649568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:16.651370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:16.756624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047574-6f12-47a1-87f4-b1f65ea4694a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:16.760847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:16.761508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:16.761801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:16.762090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:16.783063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:16.784663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:16.797318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1147/2315] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:23.024962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:23.025520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:23.025520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:23.059301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] MFA Rules not processed for user `526a63663dcb419fb7ba0052d2baef9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:23.061117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:23.159441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1169/2316] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:23.165965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:23.167986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:23.309389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2023d-8fe0-422f-9cf9-a5d1dc1b8fa5 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:23.329773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:23.329773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:23.329773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:23.329773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:23.331919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:23.461232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:23.464415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabdad7-a87b-424e-899a-f1d4eec47554 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:23.504355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1148/2317] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:27.223609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:27.225282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:27.243824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b78388-2bdb-45d1-936d-f2baa6247952 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:27.255515 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:27.258787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:27.259555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:27.260266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] PATH_INFO: `/v3/users/a523488b793c4e26b3b7039e8f5111e5` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:27.266595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a523488b793c4e26b3b7039e8f5111e5)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:27.269973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:27.345497 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:27.348316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a523488b793c4e26b3b7039e8f5111e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:27.349496 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a523488b793c4e26b3b7039e8f5111e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:27.415697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a523488b793c4e26b3b7039e8f5111e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:27.447297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a523488b793c4e26b3b7039e8f5111e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:27.448452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a523488b793c4e26b3b7039e8f5111e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:27.496833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1170/2318] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:27 2022] DELETE /identity/v3/users/a523488b793c4e26b3b7039e8f5111e5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:27.504187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5092-881d-4b0e-8e39-2fa19d0a5f30 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:27.505489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5092-881d-4b0e-8e39-2fa19d0a5f30 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:27.506190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5092-881d-4b0e-8e39-2fa19d0a5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:27.552700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:27.627636 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-673b5092-881d-4b0e-8e39-2fa19d0a5f30 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:27.628908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-673b5092-881d-4b0e-8e39-2fa19d0a5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:27.870234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1149/2319] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:27.886384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:27.889283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:28.064590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd4e3-d77e-420d-b597-d6f3098fb7d4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:28.071087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:28.071879 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:28.072290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:28.073048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:28.088511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:28.093887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:28.129829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1171/2320] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:28.545910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:28.546547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:28.546989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:28.601350 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] MFA Rules not processed for user `55d69ed62c5742d28c1f06175a02e17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:28.602806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:28.718770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1150/2321] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:28.723566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:28.725912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:28.742780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2b51-9768-4a68-a1a5-b9d5dc31ea0f service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:28.755712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:28.756449 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:28.756811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:28.757147 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:28.757836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:28.760886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:28.792719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:28.794814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:28.823318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1172/2322] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:28 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:28.826896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a045b2-34b8-4dfd-9263-986b80735cd5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:28.828046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:28.947207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3d3c1-713a-4565-85c3-f615e5b08c5e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:28.950802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:28.951870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:28.952970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:28.953751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] PATH_INFO: `/v3/projects/f294e2f0251541cc9c7aaa2ab4ca0ec0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:28.955311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f294e2f0251541cc9c7aaa2ab4ca0ec0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:28.958378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:28.964353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:28.965238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:28.965637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:28.966132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:28.967029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:28.970893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.004915 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1173/2323] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:28 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:29.008068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.022831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:29.023338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f788de-5148-4a54-a95b-7b39ed0a5448 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.036287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f294e2f0251541cc9c7aaa2ab4ca0ec0', 'request_id': 'req-1e921372-d31b-43f3-8107-590f60c26328'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:29.054876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f294e2f0251541cc9c7aaa2ab4ca0ec0', 'request_id': 'req-1e921372-d31b-43f3-8107-590f60c26328'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:29.071473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f294e2f0251541cc9c7aaa2ab4ca0ec0', 'request_id': 'req-1e921372-d31b-43f3-8107-590f60c26328'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:29.082660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:29.089672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] The token cache is being invalidate because project f294e2f0251541cc9c7aaa2ab4ca0ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:29.090790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:29.091804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1e921372-d31b-43f3-8107-590f60c26328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:29.094695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1151/2324] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:28 2022] DELETE /identity/v3/projects/f294e2f0251541cc9c7aaa2ab4ca0ec0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:29.101454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.102631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.103142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.141055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:29.141567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.142323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:29.142464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.142868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.144315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.145226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.146963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a888d-8084-4725-9355-8b4e3b97d9a5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.164839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1152/2325] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:29.165583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1174/2326] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:29.165716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.167070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:29.168020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.168438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.168819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.181097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b6171-8411-40b8-9c22-88c094181941 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.187886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.188872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.189163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.189977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] PATH_INFO: `/v3/projects/4f91069c22e145339aadfb513dd655f0/users/9acc726a07824b8fb754eac6eecf6442/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.198303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:29.200370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:29.207196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f91069c22e145339aadfb513dd655f0, user_id=9acc726a07824b8fb754eac6eecf6442, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.210567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.214910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1175/2327] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:29.217263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.228042 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74069cf-a3de-4d87-88c4-4f750d51fa8e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.236111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1153/2328] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:29 2022] PUT /identity/v3/projects/4f91069c22e145339aadfb513dd655f0/users/9acc726a07824b8fb754eac6eecf6442/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:29.240315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.311124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.312138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.312474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.312809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.313667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:13:29.314084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.316050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.330902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1176/2329] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:13:29.335536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.353088 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18885c46-84b8-4f0b-a1ee-ba82a474be85 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.353431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8f71-869e-4d9e-97a7-263e14cfd1df admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.353538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.354038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.354488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.355047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.356017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.357179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.357801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.358107 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.359158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.359594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.360403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.362517 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.369363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1154/2330] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:29.373585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.386403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe4c1-5ce9-468f-acad-a061301f4d35 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.395751 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.396385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.396679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.396965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] PATH_INFO: `/v3/projects/4f91069c22e145339aadfb513dd655f0/users/9acc726a07824b8fb754eac6eecf6442/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.399854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f91069c22e145339aadfb513dd655f0, user_id=9acc726a07824b8fb754eac6eecf6442, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.401697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1177/2331] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:13:29 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:29.402913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.407302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.415594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1155/2332] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:29 2022] PUT /identity/v3/projects/4f91069c22e145339aadfb513dd655f0/users/9acc726a07824b8fb754eac6eecf6442/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:13:29.519452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70b005-4cc5-421c-bedc-105052b004e6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.640473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:29.678942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.679198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.679458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.679769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.682778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.688048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.737105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1178/2333] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:13:29 2022] POST /identity/v3/users => generated 300 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:13:29.739806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.758805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be802-5b5f-4403-b3dd-cca07ae3a5b6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.766631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.767834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.768635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.769069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.770234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.773029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.786311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1156/2334] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:13:29.791164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.810546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5d2c-9c2e-4053-b145-ed508c7cb57b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.832298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.835031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.835615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.835987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.837601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.840197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3367eb-fcfa-400e-987b-8dae179d1545 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.865830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1179/2335] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:13:29.868016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:29.880150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2008d9-954e-4be1-a7e5-eb2a045813ca admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:29.887537 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:29.889119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.889733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.890095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] PATH_INFO: `/v3/projects/a9079707ae5249f698029b48e69addad/users/80fff05fa55c4accb025af9d604fb8b9/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:29.933990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9079707ae5249f698029b48e69addad, user_id=80fff05fa55c4accb025af9d604fb8b9, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:29.937013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:29.971139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1157/2336] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:13:29 2022] PUT /identity/v3/projects/a9079707ae5249f698029b48e69addad/users/80fff05fa55c4accb025af9d604fb8b9/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:29.991058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e0f6-69c3-41d9-b664-56c9c8ce2d40 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:29.991817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e0f6-69c3-41d9-b664-56c9c8ce2d40 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:29.992720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e0f6-69c3-41d9-b664-56c9c8ce2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:30.067637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a260e0f6-69c3-41d9-b664-56c9c8ce2d40 None None] MFA Rules not processed for user `80fff05fa55c4accb025af9d604fb8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:30.069170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a260e0f6-69c3-41d9-b664-56c9c8ce2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:30.224145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1180/2337] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:30.294407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:30.297312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:30.391581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:30.426616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5709-63fd-4f65-b844-5bbf0bea217e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:30.433652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:30.434426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:30.434846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:30.435194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:30.448176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:30.450249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:30.462680 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1158/2338] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:37.108484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559d96-2a51-42b9-a850-0a09570ac132 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:37.108941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559d96-2a51-42b9-a850-0a09570ac132 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:37.109029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559d96-2a51-42b9-a850-0a09570ac132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:37.143301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-90559d96-2a51-42b9-a850-0a09570ac132 None None] MFA Rules not processed for user `9acc726a07824b8fb754eac6eecf6442`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:37.144556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-90559d96-2a51-42b9-a850-0a09570ac132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:37.228004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1181/2339] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:39.473719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:39.586490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251f906-3355-4aef-9693-8629861bba2e service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:39.593649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:39.595060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:39.596648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:39.597119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] PATH_INFO: `/v3/users/80fff05fa55c4accb025af9d604fb8b9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:39.599242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fff05fa55c4accb025af9d604fb8b9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:39.603138 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:39.677112 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fff05fa55c4accb025af9d604fb8b9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:39.687216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fff05fa55c4accb025af9d604fb8b9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:39.705773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fff05fa55c4accb025af9d604fb8b9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:39.721145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fff05fa55c4accb025af9d604fb8b9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:39.721384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6092dc1b-8d87-4ee1-9ee9-4f2939d37541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fff05fa55c4accb025af9d604fb8b9'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:39.737987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1159/2340] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:13:39 2022] DELETE /identity/v3/users/80fff05fa55c4accb025af9d604fb8b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:39.743585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:39.744035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:39.744228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:39.757358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:39.759266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:39.760132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:39.769786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] MFA Rules not processed for user `e7566583228946488bd1ab647bbe8059`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:39.772144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:39.796875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:39.798152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:39.830758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:39.897859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1182/2341] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:13:39.955643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1160/2342] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:39.965866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:39.967365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:40.042027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325379c-f5ed-4ab0-96e2-9b8f09bbf936 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:40.058340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:40.058340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:40.058340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:40.058340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:40.066280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:40.067791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:40.082246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1183/2343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:40.441959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:40.443706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:40.458662 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6bdf6-ef08-44b2-afad-63506f01a834 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:40.466772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:40.486806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:40.490605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:40.491102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:40.491481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] PATH_INFO: `/v3/projects/a9079707ae5249f698029b48e69addad` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:40.494589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9079707ae5249f698029b48e69addad)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:40.496571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:40.579994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9079707ae5249f698029b48e69addad', 'request_id': 'req-44017d00-d888-4283-8bfe-9e9d1befc847'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:40.588169 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9079707ae5249f698029b48e69addad', 'request_id': 'req-44017d00-d888-4283-8bfe-9e9d1befc847'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:40.600067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9079707ae5249f698029b48e69addad', 'request_id': 'req-44017d00-d888-4283-8bfe-9e9d1befc847'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:40.616245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] The token cache is being invalidate because project a9079707ae5249f698029b48e69addad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:13:40.616721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:40.617259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-44017d00-d888-4283-8bfe-9e9d1befc847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:13:40.622501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1161/2344] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:13:40 2022] DELETE /identity/v3/projects/a9079707ae5249f698029b48e69addad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:13:42.940333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:42.941893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:43.009836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef7e44-83cc-4233-a3e3-4af0740320ce service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:43.063757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:43.064463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:43.064749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:43.065026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:43.066880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:43.147351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:43.149234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:43.151066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:43.161073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1184/2345] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:13:43.337927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adb2-d318-44c1-a2d3-8bfbd608e9e8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:43.338553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adb2-d318-44c1-a2d3-8bfbd608e9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:43.338553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adb2-d318-44c1-a2d3-8bfbd608e9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:43.357772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-49c9adb2-d318-44c1-a2d3-8bfbd608e9e8 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:43.359017 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-49c9adb2-d318-44c1-a2d3-8bfbd608e9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:43.419963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1162/2346] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:13:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:43.467838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:43.469239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:43.595000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042af20-92eb-4471-8338-ac79acf753bf service glance] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:43.600784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:43.601537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:43.601827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:43.602108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:43.614119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:43.616817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b72a4e-2296-462e-a7e4-2f284083b638 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:43.627954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1185/2347] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:13:43.777815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:43.778555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:43.779078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:43.800283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] MFA Rules not processed for user `cde9db32ba1c4810833f8fd824536347`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:43.801649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:43.882190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1163/2348] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:50.626488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:50.626488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:50.626488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:50.653836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:50.655243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:50.665255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1186/2349] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:50.686407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:50.720005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b208a7-e6ec-4c9d-995d-31e361d70d37 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:50.733698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:50.734575 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:50.734975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:50.735451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:50.764410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:50.766485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3bcf9-f69d-4320-884e-74eda417cd06 service swift] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:50.778085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1164/2350] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:13:53.739657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:13:53.741126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:53.888940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127aa93-dc10-4992-b8ce-8061655e6922 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:13:53.896299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:13:53.896997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:53.897287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:53.897568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:53.903027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:53.917083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:13:53.919134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a1dc-dfe2-49eb-8c2f-8a228a29cb92 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:13:53.945263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1187/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:13:55.115820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389a10-0c72-4e52-86a4-7c3e02d248af None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:55.116536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389a10-0c72-4e52-86a4-7c3e02d248af None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:55.116536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389a10-0c72-4e52-86a4-7c3e02d248af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:55.148334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4d389a10-0c72-4e52-86a4-7c3e02d248af None None] MFA Rules not processed for user `55d69ed62c5742d28c1f06175a02e17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:55.150063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4d389a10-0c72-4e52-86a4-7c3e02d248af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:55.160695 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1165/2352] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:13:55.776546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:13:55.777587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:13:55.778089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:13:55.814336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] MFA Rules not processed for user `5cf524f6288040219c0492d3a794e830`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:13:55.817204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:13:55.922885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1188/2353] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:13:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:00.462791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:00.463991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:00.464440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:00.511463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:00.517534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:00.546413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1166/2354] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:00.587744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:00.623009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c24dd-b15d-4ff7-9961-061a4f023af4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:00.639795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:00.640651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:00.643796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:00.644280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:00.670323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:00.672266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e2303-4a51-4401-a53b-d0ba7bf7e2e4 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:00.683692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:00.695641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1189/2355] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:14:03.057552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:03.059708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:03.080291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:03.313244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46c15-b12c-41ab-beb4-1db9e74aa408 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:03.333213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:03.334185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:03.338366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:03.338913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] PATH_INFO: `/v3/users/f120eb95be0b4175b3f3c0a01270b2e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:03.346030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f120eb95be0b4175b3f3c0a01270b2e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:03.352154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:03.540368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f120eb95be0b4175b3f3c0a01270b2e6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:03.568954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f120eb95be0b4175b3f3c0a01270b2e6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:03.621909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f120eb95be0b4175b3f3c0a01270b2e6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:03.643647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f120eb95be0b4175b3f3c0a01270b2e6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:03.648276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f120eb95be0b4175b3f3c0a01270b2e6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:03.675334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1167/2356] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:14:03 2022] DELETE /identity/v3/users/f120eb95be0b4175b3f3c0a01270b2e6 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:14:03.681080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:03.682089 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:03.682643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:03.753868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:03.758403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:03.916166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1190/2357] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:03.945550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:03.948612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:04.177526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3b83-1a76-4b86-9c38-20181f4eb0c2 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:04.192095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:04.193245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:04.193752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:04.194259 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:04.217975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:04.223183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549a865-0199-417b-81dd-887e1626e7d8 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:04.261965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1168/2358] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:14:06.094604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:06.097057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:06.121719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986eeb6-4be1-4d97-9f84-8118b40c2162 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:06.134708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:06.136063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:06.136543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:06.136982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] PATH_INFO: `/v3/projects/b337069f90b24ae38e6851c10ab90a27` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:06.138555 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b337069f90b24ae38e6851c10ab90a27)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:06.145392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:06.288956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b337069f90b24ae38e6851c10ab90a27', 'request_id': 'req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:06.297593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b337069f90b24ae38e6851c10ab90a27', 'request_id': 'req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:06.313758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b337069f90b24ae38e6851c10ab90a27', 'request_id': 'req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:06.339883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] The token cache is being invalidate because project b337069f90b24ae38e6851c10ab90a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:14:06.340208 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:06.341200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b3dac8f3-ea71-4102-bd6d-ea98d9ad598c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:14:06.348445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1191/2359] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:14:06 2022] DELETE /identity/v3/projects/b337069f90b24ae38e6851c10ab90a27 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:14:14.238508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:16.336447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:23.986160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:23.987371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:23.987911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:23.990030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1169/2360] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:14:24.000712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ebe2-c92d-48cc-95a8-ccead16c7c2c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.001642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ebe2-c92d-48cc-95a8-ccead16c7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.001899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ebe2-c92d-48cc-95a8-ccead16c7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.037335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e403ebe2-c92d-48cc-95a8-ccead16c7c2c None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:24.040140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e403ebe2-c92d-48cc-95a8-ccead16c7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:24.144561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1192/2361] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:24.158358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:24.161246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:24.239042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d1a5-1c75-4a2d-9158-b91906e4238b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:24.243213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:24.244128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.244411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.244698 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.263482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:24.266086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1ad6e-6014-4457-b3ac-76faff7c558e service glance] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:24.280512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1170/2362] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:14:24.361986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.362483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.362773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.364166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1193/2363] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:14:24.369740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f367-a11e-4345-83d4-e137948b3c6a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.370039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f367-a11e-4345-83d4-e137948b3c6a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.370351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f367-a11e-4345-83d4-e137948b3c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.392272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b983f367-a11e-4345-83d4-e137948b3c6a None None] MFA Rules not processed for user `a54a66e5b7c04048a1f881739e6b4ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:24.394212 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b983f367-a11e-4345-83d4-e137948b3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:24.470982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1171/2364] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:24.493036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:24.495811 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:24.525916 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3e2f7-b71d-4208-8adf-b6fc4d1e915e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:24.529944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:24.530633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.530917 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.531196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.539860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:24.541687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd5ca-6ad3-436e-89c4-64039ca66524 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:24.551348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1194/2365] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:14:24.639502 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658c65-5165-4e59-aed0-46f9f33fee41 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.639793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658c65-5165-4e59-aed0-46f9f33fee41 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.640081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658c65-5165-4e59-aed0-46f9f33fee41 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.641520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1172/2366] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 3 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:14:24.648098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.648391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.648675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.669396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] MFA Rules not processed for user `1231588fdfd54ace81dc7b2f35ec6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:24.670644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:24.680788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1195/2367] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 3 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:24.691340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11658c65-5165-4e59-aed0-46f9f33fee41 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:24.703289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11658c65-5165-4e59-aed0-46f9f33fee41 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:24.706959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:24.707615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:24.707905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:24.708189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:24.719204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:24.722366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bf6cc-ae8f-466c-a6e1-4b2954c9a399 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:24.734614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1173/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:14:29.061890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:29.063498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:29.076033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6b84-c135-4acd-9361-886b1a09aa79 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:29.079953 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:29.080620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:29.080965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:29.081194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:29.083079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:29.173164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:29.174685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:29.189096 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1196/2369] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:14:31.691246 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:31.691777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:31.691887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:31.713321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:31.714590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:31.791239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1174/2370] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:14:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:14:31.799385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:31.804970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:31.900234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f2b4-e889-47f9-9cbb-464358e344ba service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:31.907777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:31.908429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:31.909411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:31.909696 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:31.921951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:31.927500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:31.930300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da1e87-b7c8-4daf-afc6-f9c9382e65ae service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:31.943303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1197/2371] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:14:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:14:41.775463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=80 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:41.941539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:46.452170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:46.462128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22515f-94ba-42af-9209-2132d38f3fb0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:46.465994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:46.466941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:46.467388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:46.467708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:46.472379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:46.536606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:46.538086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:46.547679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1175/2372] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:14:56.543459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=30 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:59.651976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb718d-9d0b-4062-820e-6d4bed1a425a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:59.652554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb718d-9d0b-4062-820e-6d4bed1a425a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:59.652554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb718d-9d0b-4062-820e-6d4bed1a425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:59.673647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d7eb718d-9d0b-4062-820e-6d4bed1a425a None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:14:59.674930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d7eb718d-9d0b-4062-820e-6d4bed1a425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:14:59.683383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1198/2373] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:14:59.707670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:14:59.721577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e6f47-55a1-4d0c-aa9d-facdad43f6c9 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:14:59.728786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:14:59.729551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:14:59.729847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:14:59.730125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:14:59.739913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:14:59.742108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e98ddd-9a7c-4cfd-8e53-a9241c4c3aa7 service swift] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:14:59.751301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1176/2374] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:15:09.666954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:09.747330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:18.205391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:15:18.206530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:15:18.206530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:15:18.230196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] MFA Rules not processed for user `e7566583228946488bd1ab647bbe8059`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:15:18.231494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:15:18.295813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1199/2375] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:15:28.288977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=25 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:41.386466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab26b7-1df6-4299-8469-d3c0003f2e65 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:15:41.387297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab26b7-1df6-4299-8469-d3c0003f2e65 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:15:41.387761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab26b7-1df6-4299-8469-d3c0003f2e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:15:41.427351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6fab26b7-1df6-4299-8469-d3c0003f2e65 None None] MFA Rules not processed for user `cde9db32ba1c4810833f8fd824536347`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:15:41.429523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6fab26b7-1df6-4299-8469-d3c0003f2e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:15:41.518331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1177/2376] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:15:51.508147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=25 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:55.888622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:15:55.904348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757d77-6340-4efa-a761-2f1150f4e4a2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:15:55.908376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:15:55.909010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:15:55.909289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:15:55.909565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:15:55.911419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:15:55.925544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:15:55.927106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:15:55.939206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1200/2377] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:15:58.286512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:15:58.287076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:15:58.287076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:15:58.308316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] MFA Rules not processed for user `42ce2627c0f142f8892c182f69ef9a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:15:58.309526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:15:58.368237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1178/2378] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:15:59.174189 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:15:59.186904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdec0-f191-4d42-874e-5431d05414c9 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:15:59.192415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:15:59.194003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:15:59.194431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:15:59.194883 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:15:59.197389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:15:59.216099 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:15:59.217443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:15:59.231717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1201/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:16:08.360822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=25 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:09.226619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=12 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:16.123748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:16.125461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:16.144689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bb91-b229-4aaf-81c0-bff99e9eb6c4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:16.151647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:16.152448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:16.152772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:16.153091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:16.155292 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:16.168418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:16.170331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0aba-0872-48b7-b613-0afaf8e33901 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:16.182865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1179/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:26.177063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:26.278641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:26.280095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:26.338211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3daf-68ec-4d43-a6af-3064f25633bf service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:26.342435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:26.343104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:26.343383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:26.343660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:26.345625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:26.357930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:26.359397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:26.370053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1202/2381] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:36.364635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=26 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:39.651598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:39.652128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:39.652128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:39.674093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] MFA Rules not processed for user `e7566583228946488bd1ab647bbe8059`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:16:39.675260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:39.687520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1180/2382] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:16:40.127012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:40.141946 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641e53-3c0f-44f8-9a35-fc806d7ad729 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:40.146808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:40.147701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:40.147981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:40.148257 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:40.150316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:40.162223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:40.163746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65f2f0-5d10-4ab6-8164-92081ff2c989 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:40.173040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1203/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:16:40.571893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:40.574115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:40.674587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636532c-3d5a-43bc-bee3-f09ed45f6b4f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:40.680027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:40.680668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:40.680956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:40.681237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:40.683104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:40.695641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:40.697325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:40.707928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1181/2384] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:40.861939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:40.862237 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:40.862568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:40.882756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:16:40.884024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:40.892389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1204/2385] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:16:40.954513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:40.972086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ba581-9e31-4304-a326-0dd855fb7313 service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:40.977607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:40.978550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:40.978872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:40.979151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:40.989314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:40.991270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:41.001347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1182/2386] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:16:42.711463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:42.732130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e76b9-23ad-4a29-acd8-0c090270643c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:42.739291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:42.740845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:42.741837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:42.742798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:42.747733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:42.779785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:42.782419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:42.805587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1205/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:46.112885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:46.128260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06f13-9b16-41b3-8ae7-dc53261cd97f service swift] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:46.139487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:46.141612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:46.142156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:46.142707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:46.157474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:46.177456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:46.185151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:46.194115 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1183/2388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:46.539440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:46.541291 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:46.559473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b58fd-4a54-48ef-ae0e-5b3b160f4aaa service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:46.567377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:46.568313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:46.568783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:46.569301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:46.571265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:46.588531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:46.590062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:46.603558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1206/2389] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:50.585049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:50.587716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:50.687001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e8663-4875-497a-8463-4577532ec197 service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:50.692090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:50.693314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:50.693692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:50.693966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] PATH_INFO: `/v3/users/55d69ed62c5742d28c1f06175a02e17f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:50.695304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d69ed62c5742d28c1f06175a02e17f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:50.697324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:50.762540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d69ed62c5742d28c1f06175a02e17f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:50.770161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d69ed62c5742d28c1f06175a02e17f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:50.772771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:50.785046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d69ed62c5742d28c1f06175a02e17f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:50.796813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d69ed62c5742d28c1f06175a02e17f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:50.797483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d69ed62c5742d28c1f06175a02e17f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:50.804344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1184/2390] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:16:50 2022] DELETE /identity/v3/users/55d69ed62c5742d28c1f06175a02e17f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:16:51.087557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:51.105628 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4486-53b0-4f9f-9072-8155f1358c7e service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:51.180631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:51.181295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:51.181581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:51.181860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] PATH_INFO: `/v3/projects/3156a99cf94e4845b22550fe2e064849` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:51.183067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=3156a99cf94e4845b22550fe2e064849)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:51.185045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:51.233081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3156a99cf94e4845b22550fe2e064849', 'request_id': 'req-23752e32-58c6-4f29-b4d0-50cc313a2ede'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.239135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3156a99cf94e4845b22550fe2e064849', 'request_id': 'req-23752e32-58c6-4f29-b4d0-50cc313a2ede'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.246413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3156a99cf94e4845b22550fe2e064849', 'request_id': 'req-23752e32-58c6-4f29-b4d0-50cc313a2ede'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.260013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] The token cache is being invalidate because project 3156a99cf94e4845b22550fe2e064849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:16:51.260352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.260962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.262541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1207/2391] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:16:51 2022] DELETE /identity/v3/projects/3156a99cf94e4845b22550fe2e064849 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:16:51.266682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:51.268254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:51.283449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687acc6-1325-4f3a-bf2a-0f4482ef452f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:51.344096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:51.344673 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:51.344966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:51.345252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] PATH_INFO: `/v3/users/9acc726a07824b8fb754eac6eecf6442` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:51.346587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acc726a07824b8fb754eac6eecf6442)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:51.348432 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:51.403381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acc726a07824b8fb754eac6eecf6442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.411047 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acc726a07824b8fb754eac6eecf6442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.423679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acc726a07824b8fb754eac6eecf6442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.431439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acc726a07824b8fb754eac6eecf6442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.432107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acc726a07824b8fb754eac6eecf6442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.438327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1185/2392] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:16:51 2022] DELETE /identity/v3/users/9acc726a07824b8fb754eac6eecf6442 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:16:51.647513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:51.649610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:51.664693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752e32-58c6-4f29-b4d0-50cc313a2ede admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:51.719106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:51.737563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:51.738255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:51.738559 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:51.738865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] PATH_INFO: `/v3/projects/4f91069c22e145339aadfb513dd655f0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:51.740262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f91069c22e145339aadfb513dd655f0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:51.742207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:51.798200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f91069c22e145339aadfb513dd655f0', 'request_id': 'req-4cf50fc4-4d1c-4fc5-a726-2751144505eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.804435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f91069c22e145339aadfb513dd655f0', 'request_id': 'req-4cf50fc4-4d1c-4fc5-a726-2751144505eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.812026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f91069c22e145339aadfb513dd655f0', 'request_id': 'req-4cf50fc4-4d1c-4fc5-a726-2751144505eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.826307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] The token cache is being invalidate because project 4f91069c22e145339aadfb513dd655f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:16:51.826650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.827351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:16:51.828896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1208/2393] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:16:51 2022] DELETE /identity/v3/projects/4f91069c22e145339aadfb513dd655f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:16:54.270474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:54.273729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:54.586408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:54.648550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:54.651492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:54.651880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b3eb-d739-4ce2-8b65-224381e760f4 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:54.823825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf50fc4-4d1c-4fc5-a726-2751144505eb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:54.836078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:54.839743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:54.840171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:54.840606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:54.841149 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:54.843279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:54.843633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:54.845354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:54.845657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:54.850585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:54.881717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:54.883468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642f1f-9469-4e62-9835-aac19a43531c service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:54.930567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1186/2394] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:54.993071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:54.994663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:55.007904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1209/2395] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:16:55.642672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:55.643241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:55.643241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:55.669659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] MFA Rules not processed for user `5cf524f6288040219c0492d3a794e830`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:16:55.671011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:55.746348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1187/2396] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:16:56.493380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:16:56.496069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:56.515670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfd19a-24b8-4025-b6db-a52297ee0051 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:16:56.523839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:16:56.524707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:16:56.525057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:16:56.525347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:16:56.527529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:16:56.605082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:56.702054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:16:56.706055 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:16:56.729449 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1210/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:17:01.750543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:01.753124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:01.768549 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d256-1d32-4375-8466-95fb1f5dc9f4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:01.774205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:01.774920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:01.775201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:01.775726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] PATH_INFO: `/v3/users/cde9db32ba1c4810833f8fd824536347` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:01.777428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde9db32ba1c4810833f8fd824536347)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:01.779503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:01.854933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde9db32ba1c4810833f8fd824536347'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:01.863976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde9db32ba1c4810833f8fd824536347'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:01.879780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde9db32ba1c4810833f8fd824536347'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:01.884248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:01.889944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde9db32ba1c4810833f8fd824536347'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:01.891160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-4becf200-0ac9-4756-8ac7-645c111ade00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde9db32ba1c4810833f8fd824536347'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:01.900550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1188/2398] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:01 2022] DELETE /identity/v3/users/cde9db32ba1c4810833f8fd824536347 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:02.179335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.202769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9e52-bf46-47d0-9564-c70c622d6373 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.301999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.302856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.303424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.303787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] PATH_INFO: `/v3/projects/d51be67fb4974085b55f3dcfcc2c70aa` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.305319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51be67fb4974085b55f3dcfcc2c70aa)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.307609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:02.375149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51be67fb4974085b55f3dcfcc2c70aa', 'request_id': 'req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:02.384029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51be67fb4974085b55f3dcfcc2c70aa', 'request_id': 'req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:02.392746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51be67fb4974085b55f3dcfcc2c70aa', 'request_id': 'req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:02.411271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] The token cache is being invalidate because project d51be67fb4974085b55f3dcfcc2c70aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:02.411683 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:02.412783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9e86dda-68c0-4a41-9d47-e502ecffc2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:02.415429 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1211/2399] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:02 2022] DELETE /identity/v3/projects/d51be67fb4974085b55f3dcfcc2c70aa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:02.436025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.436539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.437010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.471578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:02.474143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:02.585237 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1189/2400] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:02.593806 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.594102 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.594466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.653865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:02.659792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:02.679926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1212/2401] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:02.684280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.699137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516d266-9e6d-48c3-a1ce-e5b0224a21b6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.705029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.705678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.706489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.706661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.707604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:17:02.709042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.710911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:02.730340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1190/2402] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:17:02.734336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.744942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c5665-d3c6-4bfe-a464-ea95c6369773 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.753588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.754369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.754814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.755164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.755978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.757997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:02.790199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1213/2403] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:02.794761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.806385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf480-2cc5-4d70-8460-bbc54a6068d5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.874171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.874843 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.875142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.875409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.876084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.878049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:02.912954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1191/2404] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:02 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:02.914569 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.926870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173496f-1d7a-406d-b3f9-e0489e7c261c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.932311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.932963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.933263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.933529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.934247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.935964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:02.947474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1214/2405] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:17:02.952060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:02.977917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f8174-992c-4f47-8c3c-9e8c21a86f88 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:02.984388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:02.985430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:02.985771 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:02.986056 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:02.987417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:02.989374 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e1aa-2e8f-4d8f-a2a1-27e36aef5bc4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.010940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1192/2406] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:03.016125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.028756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b2aea-73e8-4077-bf59-1ccf0b6b7914 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.035489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.036783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.037066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.037345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] PATH_INFO: `/v3/projects/468a894093ef40839ea44a01a84d7530/users/06cf35e1783c48af8a9f43ef8991fdf3/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.051956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:03.058712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468a894093ef40839ea44a01a84d7530, user_id=06cf35e1783c48af8a9f43ef8991fdf3, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.062098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.086798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1215/2407] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:03 2022] PUT /identity/v3/projects/468a894093ef40839ea44a01a84d7530/users/06cf35e1783c48af8a9f43ef8991fdf3/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:17:03.098042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.099420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.099722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.142803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] MFA Rules not processed for user `06cf35e1783c48af8a9f43ef8991fdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:03.145947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:03.211550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:03.237941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1193/2408] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:03.243051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.350803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1419a23-eb3b-4d6b-9885-24ecf874f987 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.359706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.360828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.361479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.362940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.363715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.367670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.417570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.430636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1216/2409] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:03 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:03.439046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824ad95-e688-4fc1-9ea2-476fa2543d51 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.559050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.559838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.560097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.560413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.561117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.563164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.603646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1194/2410] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:03 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:03.608673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.627786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2931f-4f40-45b5-a529-a64b3f24dd28 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.636751 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.638051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.638571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.639152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.640581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.643814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.663251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1217/2411] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:03.667927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.688183 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bbc25-8b6d-46dd-a69c-a24f3307b86c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.698635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.698635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.698635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.699175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] PATH_INFO: `/v3/projects/85b04b6e4c98430ba0cc259a974b13e9/users/1595c6e1f85c413b8c5dd0fe26eb078b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.722912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b04b6e4c98430ba0cc259a974b13e9, user_id=1595c6e1f85c413b8c5dd0fe26eb078b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.726024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.746276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1195/2412] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:03 2022] PUT /identity/v3/projects/85b04b6e4c98430ba0cc259a974b13e9/users/1595c6e1f85c413b8c5dd0fe26eb078b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:03.750601 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.766570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e38d-b33e-44ca-9c1b-c38768eda390 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.901468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.902476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.902926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.903351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.904224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.906038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22edf2-e998-4510-b004-50fffda29125 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.920652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1218/2413] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:03.925356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:03.938216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23f1f5-7994-435e-92a7-a17f08e8d657 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:03.944211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:03.944928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.945220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.945571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] PATH_INFO: `/v3/projects/85b04b6e4c98430ba0cc259a974b13e9/users/1595c6e1f85c413b8c5dd0fe26eb078b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:03.948129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b04b6e4c98430ba0cc259a974b13e9, user_id=1595c6e1f85c413b8c5dd0fe26eb078b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:03.951650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:03.963951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1196/2414] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:03 2022] PUT /identity/v3/projects/85b04b6e4c98430ba0cc259a974b13e9/users/1595c6e1f85c413b8c5dd0fe26eb078b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:03.977730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:03.978603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:03.979045 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:04.016780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] MFA Rules not processed for user `1595c6e1f85c413b8c5dd0fe26eb078b`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:04.018194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:04.097743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:04.135834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1219/2415] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:04.150649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:04.152991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:04.257630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055497d2-57d1-4bc3-be1a-de74db1e2585 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:04.264533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:04.265975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:04.266679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:04.267390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:04.286590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:04.289910 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f12ea7-3991-42b0-8783-8385f199aac1 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:04.310273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1197/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:04.868305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:04.975160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91b0e9-4e4f-4adf-953f-63603775a700 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:04.980053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:04.981173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:04.981660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:04.982150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] PATH_INFO: `/v3/users/06cf35e1783c48af8a9f43ef8991fdf3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:04.984531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cf35e1783c48af8a9f43ef8991fdf3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:04.987230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:05.080289 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cf35e1783c48af8a9f43ef8991fdf3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:05.081446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cf35e1783c48af8a9f43ef8991fdf3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:05.106268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cf35e1783c48af8a9f43ef8991fdf3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:05.121149 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cf35e1783c48af8a9f43ef8991fdf3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:05.122889 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cf35e1783c48af8a9f43ef8991fdf3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:05.151135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1220/2417] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:04 2022] DELETE /identity/v3/users/06cf35e1783c48af8a9f43ef8991fdf3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:05.159901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:05.159901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:05.159901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:05.189905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:05.191141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:05.253205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:05.284600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1198/2418] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:05.295371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:05.297035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:05.399031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046abb4-ea99-438f-a4b6-68a827ac623e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:05.404077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:05.404894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:05.405339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:05.405544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:05.422587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:05.425100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:05.441039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1221/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:17:05.922685 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:05.924925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:05.939874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0036bd6-d465-48e0-9443-f3b548ad4bd4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:05.947310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:05.948327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:05.948860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:05.949383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] PATH_INFO: `/v3/projects/468a894093ef40839ea44a01a84d7530` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:05.951429 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468a894093ef40839ea44a01a84d7530)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:05.954968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:06.026953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468a894093ef40839ea44a01a84d7530', 'request_id': 'req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.040440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468a894093ef40839ea44a01a84d7530', 'request_id': 'req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.046938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468a894093ef40839ea44a01a84d7530', 'request_id': 'req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.073175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] The token cache is being invalidate because project 468a894093ef40839ea44a01a84d7530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:06.073455 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.074252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.076754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1199/2420] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:05 2022] DELETE /identity/v3/projects/468a894093ef40839ea44a01a84d7530 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:06.081071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:06.099137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82388c5-d855-426a-8662-f6ef20fe64d2 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:06.103624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:06.186039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:06.186949 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:06.187236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:06.187694 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] PATH_INFO: `/v3/users/1595c6e1f85c413b8c5dd0fe26eb078b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:06.189269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1595c6e1f85c413b8c5dd0fe26eb078b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:06.191615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:06.280392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1595c6e1f85c413b8c5dd0fe26eb078b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.281484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1595c6e1f85c413b8c5dd0fe26eb078b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.302141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1595c6e1f85c413b8c5dd0fe26eb078b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.313296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1595c6e1f85c413b8c5dd0fe26eb078b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.315224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72d3a651-0597-4bb5-8322-9bebbe24a01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1595c6e1f85c413b8c5dd0fe26eb078b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:06.359413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1222/2421] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:06 2022] DELETE /identity/v3/users/1595c6e1f85c413b8c5dd0fe26eb078b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:06.847266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:06.849896 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:06.894478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8873b-0ddc-46ab-a5b4-fe8430aa5cd8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:06.964593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:06.965604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:06.965960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:06.966321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] PATH_INFO: `/v3/projects/85b04b6e4c98430ba0cc259a974b13e9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:06.968218 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b04b6e4c98430ba0cc259a974b13e9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:06.970741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.045382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b04b6e4c98430ba0cc259a974b13e9', 'request_id': 'req-2552edeb-d016-4969-ba91-b11d7f90832e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:07.054496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b04b6e4c98430ba0cc259a974b13e9', 'request_id': 'req-2552edeb-d016-4969-ba91-b11d7f90832e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:07.062113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b04b6e4c98430ba0cc259a974b13e9', 'request_id': 'req-2552edeb-d016-4969-ba91-b11d7f90832e'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:07.071249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:07.076735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] The token cache is being invalidate because project 85b04b6e4c98430ba0cc259a974b13e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:07.077463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:07.079154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2552edeb-d016-4969-ba91-b11d7f90832e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:07.081734 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1200/2422] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:06 2022] DELETE /identity/v3/projects/85b04b6e4c98430ba0cc259a974b13e9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:07.086920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.087446 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.087961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.109539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:07.110852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:07.177733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1223/2423] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:07.186706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.187247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.187745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.218538 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:07.220421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:07.238512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1201/2424] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:07.240087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.251933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565630c4-359d-45d5-83aa-dd9000dea855 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.257209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.258014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.260842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.261103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.262264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:17:07.262835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.264582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.282413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1224/2425] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:17:07.287452 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.297165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927200a2-9ff5-4ec7-a274-c9a35d1b1c39 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.303567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.304398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.304693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.304979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.306089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.309987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.359104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1202/2426] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:07.365190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.377190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13eae-f31c-490b-a114-d51125562229 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.404595 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:07.492409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.493063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.493353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.493632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.494402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.496480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.523969 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1225/2427] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:07.530364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.550142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d272-5cca-4777-87db-6e82fb28e5ba admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.559981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.560948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.561456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.561961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.564132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.566478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.589438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1203/2428] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:07.594120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.608647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11342b39-8ef6-401d-8e4f-2de66aac9606 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.614426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.615008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.615386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.615554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.616281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.617944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c876ae-ceaa-4d41-a387-443855dad974 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.637548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1226/2429] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:17:07.644016 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.668793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41c1a-2fb3-4da9-9b14-15ff9364af96 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.675409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:07.676498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.676723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.676866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] PATH_INFO: `/v3/projects/3d5132fb21c24b29b8cdc7f02c7bc2e3/users/cb402afddbce4e81ac73203d6a1fcaf8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.706174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5132fb21c24b29b8cdc7f02c7bc2e3, user_id=cb402afddbce4e81ac73203d6a1fcaf8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:07.711992 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:07.755194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1204/2430] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:07 2022] PUT /identity/v3/projects/3d5132fb21c24b29b8cdc7f02c7bc2e3/users/cb402afddbce4e81ac73203d6a1fcaf8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:07.762316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:07.762706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:07.763008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:07.794597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] MFA Rules not processed for user `cb402afddbce4e81ac73203d6a1fcaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:07.795893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:07.909450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1227/2431] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:07.915631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:07.994601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324aff4-54d9-45b0-893c-39861d8f1b4a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:07.999699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.000346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.000665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.001118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.001790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.003827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af4405-0729-45e3-88e7-24d0bb72fc9d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.038019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1205/2432] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:07 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:08.039977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.053996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8f26-5ebf-40ad-be58-e01ec594eb73 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.129581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.130262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.130681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.131033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.131757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.134702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.163118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.163310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.163626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.170813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1228/2433] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:08 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:08.175955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.188039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351260-ad27-49de-adfa-8f7aae803c18 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.189178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] MFA Rules not processed for user `023c699e0cac426f8e7229ebbb7727b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:08.190424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:08.197359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.198025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.198315 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.198681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.199399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.201020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.210872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:08.216498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1229/2434] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:17:08.220783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.233502 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97671a-f57f-434a-8e65-d5f682ea172e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.243072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.243813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.244260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.244584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] PATH_INFO: `/v3/projects/d5a09545dad34de8adfe66bdf2196955/users/ef36c3fa73e547f39f8ce7eb290d7bfe/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.263746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1206/2435] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:08.263981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a09545dad34de8adfe66bdf2196955, user_id=ef36c3fa73e547f39f8ce7eb290d7bfe, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.266224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.287002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1230/2436] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:08 2022] PUT /identity/v3/projects/d5a09545dad34de8adfe66bdf2196955/users/ef36c3fa73e547f39f8ce7eb290d7bfe/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:17:08.291459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.306062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf96d-f7d1-4a11-8186-eab081bfce8f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.335924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:08.380410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.381509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.381813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.382093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.382851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.384540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34d29c-46fa-42e5-9c15-e7e34e789fec admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.400736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1207/2437] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:17:08.404689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.424894 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66ee5-1355-44cc-a701-689e09d76a4c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.431902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.432707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.433019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.433304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] PATH_INFO: `/v3/projects/d5a09545dad34de8adfe66bdf2196955/users/ef36c3fa73e547f39f8ce7eb290d7bfe/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.439347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a09545dad34de8adfe66bdf2196955, user_id=ef36c3fa73e547f39f8ce7eb290d7bfe, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.443175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.463345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1231/2438] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:08 2022] PUT /identity/v3/projects/d5a09545dad34de8adfe66bdf2196955/users/ef36c3fa73e547f39f8ce7eb290d7bfe/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:08.474560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.474793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.475081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.508287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] MFA Rules not processed for user `ef36c3fa73e547f39f8ce7eb290d7bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:08.509520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:08.590859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1208/2439] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:08.608258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.610747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:08.704932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1298-6e60-4dff-b214-01197fdac73d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.710175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.710922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.711242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.711624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.722599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.724562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.735874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1232/2440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:08.827007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:08.840622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9601c8c-0e42-4125-bb78-3b579194b883 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:08.845486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:08.846405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:08.846918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:08.847416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:08.920669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:08.922394 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6d2ab-e941-4772-a2b6-3f68774da131 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:08.933725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1209/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:09.358544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:09.440488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a197452-6005-4f05-b0a5-fdbfab108868 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:09.446839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:09.447738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:09.448178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:09.448616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] PATH_INFO: `/v3/users/cb402afddbce4e81ac73203d6a1fcaf8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:09.450165 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb402afddbce4e81ac73203d6a1fcaf8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:09.452461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:09.512554 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb402afddbce4e81ac73203d6a1fcaf8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:09.513294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb402afddbce4e81ac73203d6a1fcaf8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:09.527814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb402afddbce4e81ac73203d6a1fcaf8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:09.530256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:09.536962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb402afddbce4e81ac73203d6a1fcaf8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:09.539009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb402afddbce4e81ac73203d6a1fcaf8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:09.554913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1233/2442] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:09 2022] DELETE /identity/v3/users/cb402afddbce4e81ac73203d6a1fcaf8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:09.560176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:09.560530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:09.560888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:09.581943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:09.583901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:09.632479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:09.652462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1210/2443] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:09.663621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:09.665926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:09.738698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5352ee-742c-4dbc-86be-8fa1da101cb3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:09.743730 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:09.744615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:09.744996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:09.745372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:09.756881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:09.758386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:09.769408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1234/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:10.201711 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:10.203540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:10.235809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25fcf-db3c-4d33-9569-ba7fe916dd8f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:10.245545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:10.261782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:10.262177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:10.262560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] PATH_INFO: `/v3/projects/3d5132fb21c24b29b8cdc7f02c7bc2e3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:10.282879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5132fb21c24b29b8cdc7f02c7bc2e3)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:10.286719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:10.407244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5132fb21c24b29b8cdc7f02c7bc2e3', 'request_id': 'req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.425881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5132fb21c24b29b8cdc7f02c7bc2e3', 'request_id': 'req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.441801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5132fb21c24b29b8cdc7f02c7bc2e3', 'request_id': 'req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.466514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] The token cache is being invalidate because project 3d5132fb21c24b29b8cdc7f02c7bc2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:10.467148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.468518 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.470580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1211/2445] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:10 2022] DELETE /identity/v3/projects/3d5132fb21c24b29b8cdc7f02c7bc2e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:10.475435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:10.490947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfb54-e4eb-4ebf-8127-319e000787a4 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:10.622385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:10.623330 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:10.623774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:10.624066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] PATH_INFO: `/v3/users/ef36c3fa73e547f39f8ce7eb290d7bfe` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:10.627520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef36c3fa73e547f39f8ce7eb290d7bfe)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:10.630611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:10.692079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef36c3fa73e547f39f8ce7eb290d7bfe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.692890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef36c3fa73e547f39f8ce7eb290d7bfe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.707229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef36c3fa73e547f39f8ce7eb290d7bfe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.717186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef36c3fa73e547f39f8ce7eb290d7bfe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.717925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d631aa3a-f637-425d-b3f3-d32ea43a9d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef36c3fa73e547f39f8ce7eb290d7bfe'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:10.740957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1235/2446] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:10 2022] DELETE /identity/v3/users/ef36c3fa73e547f39f8ce7eb290d7bfe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:11.193684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:11.195261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:11.210049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c2f49-2ab3-4509-bf94-ac8a23f19286 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:11.289744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:11.291613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.291965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.292306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] PATH_INFO: `/v3/projects/d5a09545dad34de8adfe66bdf2196955` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.293931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a09545dad34de8adfe66bdf2196955)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:11.297069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:11.364907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a09545dad34de8adfe66bdf2196955', 'request_id': 'req-7a6e59b4-4a87-4950-97e1-d6c592945cd0'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:11.374622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a09545dad34de8adfe66bdf2196955', 'request_id': 'req-7a6e59b4-4a87-4950-97e1-d6c592945cd0'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:11.387540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a09545dad34de8adfe66bdf2196955', 'request_id': 'req-7a6e59b4-4a87-4950-97e1-d6c592945cd0'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:11.397849 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:11.403071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] The token cache is being invalidate because project d5a09545dad34de8adfe66bdf2196955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:11.403943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:11.405866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-7a6e59b4-4a87-4950-97e1-d6c592945cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:11.409195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1212/2447] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:11 2022] DELETE /identity/v3/projects/d5a09545dad34de8adfe66bdf2196955 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:17:11.415124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.415529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.415877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.459017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:11.472173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:11.481124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:11.599526 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1236/2448] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:11.603920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.604545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.605091 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.662196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:11.663607 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:11.690102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1213/2449] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:11.692073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:11.716783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0b904-1fc8-43bb-8fe7-bb6ae59af2f2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:11.725164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:11.726427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.726942 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.727414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.728732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:17:11.729248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:11.732244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:11.764670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1237/2450] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:17:11.767842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:11.787981 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9830a6-bc55-4b6b-800c-10e3b1525a38 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:11.793418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:11.794494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.794977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.795434 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.796224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:11.798933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:11.842599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1214/2451] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:11 2022] POST /identity/v3/projects => generated 361 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:11.846831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:11.858599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9c2e-425c-4730-b133-fbfbaac2dd53 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:11.934362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:11.935216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.935506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.935794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.936476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:11.938486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:11.967984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1238/2452] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:11 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:11.971979 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:11.983874 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75e1bf-1c14-4e8d-bf7b-14762bc60595 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:11.990321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:11.991034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:11.991369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:11.991621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:11.992344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:11.994085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.009437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1215/2453] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:12.010477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.025640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80d78-7308-4e72-968a-80f3179322de admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.030831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.031469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.031760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.032039 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.032740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:12.034383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5eb5e-cb9d-4387-b5b1-ecc3207fa0a2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.047037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1239/2454] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:12.051467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.065600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5123f-901b-49fa-b49f-8041b99d74f4 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.071157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.072038 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.072407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.072713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] PATH_INFO: `/v3/projects/30a30f54b1024ddb9f2de434e18fb325/users/5d8348734a0e468aaf5d47d1aec56381/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.090001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a30f54b1024ddb9f2de434e18fb325, user_id=5d8348734a0e468aaf5d47d1aec56381, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:12.093048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.108838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1216/2455] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:12 2022] PUT /identity/v3/projects/30a30f54b1024ddb9f2de434e18fb325/users/5d8348734a0e468aaf5d47d1aec56381/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:12.121394 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055276-7527-46ad-9144-4ba10611d874 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.121690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055276-7527-46ad-9144-4ba10611d874 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.121967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055276-7527-46ad-9144-4ba10611d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.158722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-83055276-7527-46ad-9144-4ba10611d874 None None] MFA Rules not processed for user `5d8348734a0e468aaf5d47d1aec56381`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:12.160214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-83055276-7527-46ad-9144-4ba10611d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.278692 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1240/2456] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:12.301077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.303875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.333681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055276-7527-46ad-9144-4ba10611d874 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.335904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-83055276-7527-46ad-9144-4ba10611d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.343962 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:12.423650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7a12-9bb2-452e-9220-f65f96c3653c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.435824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.437076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.437447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.438039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.450635 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:12.452500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.464014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1217/2457] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:12.465186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055276-7527-46ad-9144-4ba10611d874 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.474869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.476022 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.476307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.476814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.480098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.484153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.526936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:12.531761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e60ef-4189-4cf7-b29b-90e16e084df2 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.572367 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1241/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:12.622048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8021a6-e8f0-4665-b82f-78a9184f2e42 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.629872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.631124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.631693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.632128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] PATH_INFO: `/v3/users/5d8348734a0e468aaf5d47d1aec56381` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.633670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8348734a0e468aaf5d47d1aec56381)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:12.635872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:12.693477 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:12.701061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8348734a0e468aaf5d47d1aec56381'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:12.714271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8348734a0e468aaf5d47d1aec56381'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:12.732545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8348734a0e468aaf5d47d1aec56381'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:12.744090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8348734a0e468aaf5d47d1aec56381'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:12.744815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8348734a0e468aaf5d47d1aec56381'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:12.756413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1218/2459] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:12 2022] DELETE /identity/v3/users/5d8348734a0e468aaf5d47d1aec56381 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:12.761766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.762163 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.762546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:12.784001 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:12.785627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.877790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1242/2460] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:12.900944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:12.903961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:12.980557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629a88-a4a9-483b-ab75-4f7b6e8418f8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:12.985252 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:12.985973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:12.986388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:12.987084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.000845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:13.002671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a0a2e-3d2d-4756-94c9-85d28ec81ac3 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:13.019446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1219/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:17:13.634366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:13.636181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:13.651783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b853a-182d-4af8-a541-9b3d5997448d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:13.656756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:13.657433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:13.657725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:13.657983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] PATH_INFO: `/v3/projects/30a30f54b1024ddb9f2de434e18fb325` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.659466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a30f54b1024ddb9f2de434e18fb325)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:13.663379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:13.722900 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a30f54b1024ddb9f2de434e18fb325', 'request_id': 'req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:13.730430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a30f54b1024ddb9f2de434e18fb325', 'request_id': 'req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:13.737205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a30f54b1024ddb9f2de434e18fb325', 'request_id': 'req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:13.758103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] The token cache is being invalidate because project 30a30f54b1024ddb9f2de434e18fb325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:13.758403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:13.759142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9fe833ed-cf4d-4ec1-beef-e26d5d587d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:13.760773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1243/2462] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:13 2022] DELETE /identity/v3/projects/30a30f54b1024ddb9f2de434e18fb325 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:13.766161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:13.767052 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:13.767227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.788484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:13.789707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:13.853282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1220/2463] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:13.861703 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:13.861992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:13.862279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.884047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:13.885277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:13.894051 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1244/2464] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:13.900324 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:13.914539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd809f-3037-4c24-82c6-3e5ec93c7a22 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:13.920021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:13.920826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:13.921156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:13.921523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.922534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:17:13.922978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:13.924952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:13.939812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1221/2465] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:17:13.947093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:13.956945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:13.964267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd5ee-2b1e-4da7-8320-ee4485911346 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:13.975592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:13.976771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:13.977307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:13.977783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:13.979395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:13.982155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.032314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1245/2466] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:13 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:14.034174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:14.048063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b4bf-a548-4e94-a56a-0161aa970758 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:14.118820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:14.138127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:14.138950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.139242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.139541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.140213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:14.154020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.172383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1222/2467] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:14 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:17:14.173747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:14.186366 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1802b-3237-43ac-aef3-8c8b359731ed admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:14.192553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:14.193202 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.193520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.193805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.194556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:14.196187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.210928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1246/2468] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:14.212571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:14.223594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6a2e-31b3-4710-992a-bfa148070261 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:14.229971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:14.230731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.231027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.231310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.232024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:14.233847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1237f-90f1-44c5-8981-ca7b9f72c323 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.247940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1223/2469] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:14.253023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:14.264403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba347d-6310-445e-a184-4d0316d27eb8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:14.269527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:14.270233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.270673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.270979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] PATH_INFO: `/v3/projects/bc9741bf1f6e477b801ed8b81b565e67/users/440182a181d14ac18aabef41bfdeb784/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.287246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9741bf1f6e477b801ed8b81b565e67, user_id=440182a181d14ac18aabef41bfdeb784, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:14.289826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.319048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1247/2470] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:14 2022] PUT /identity/v3/projects/bc9741bf1f6e477b801ed8b81b565e67/users/440182a181d14ac18aabef41bfdeb784/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:17:14.330947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.331241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.331550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.364951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] MFA Rules not processed for user `440182a181d14ac18aabef41bfdeb784`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:14.366302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:14.456689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1224/2471] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:14.468363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:14.471129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:14.544677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8800f76-3edf-44e6-b614-c4161347a3e1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:14.548852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:14.549527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:14.549840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:14.550114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:14.560599 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:14.562067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a9e6a-a4d1-4b70-b310-b80d75536805 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:14.572106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1248/2472] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:17.318077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:17.436481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b0123-1dbc-4d1d-b121-6987571f7596 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:17.444331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:17.445463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:17.445973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:17.446511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] PATH_INFO: `/v3/users/440182a181d14ac18aabef41bfdeb784` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:17.448540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440182a181d14ac18aabef41bfdeb784)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:17.451839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:17.519468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440182a181d14ac18aabef41bfdeb784'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:17.532012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440182a181d14ac18aabef41bfdeb784'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:17.534013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:17.549190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440182a181d14ac18aabef41bfdeb784'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:17.560701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440182a181d14ac18aabef41bfdeb784'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:17.561745 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440182a181d14ac18aabef41bfdeb784'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:17.573858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1225/2473] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:17 2022] DELETE /identity/v3/users/440182a181d14ac18aabef41bfdeb784 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:17.575921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:17.576414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:17.576630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:17.596763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:17.598028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:17.677940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1249/2474] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:17.688840 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:17.690892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:17.797862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d4b74-4f34-4eb7-9d7f-2bb5fdc41dd6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:17.801879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:17.802580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:17.802869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:17.803153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:17.813725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:17.815820 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c5f11-60f0-4337-bf98-5440fdc0cf1d service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:17.829875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1226/2475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:18.440263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:18.443627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:18.478360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115a88-e189-4161-b6c3-4ea938b1518c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:18.491442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:18.492535 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:18.493041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:18.493758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] PATH_INFO: `/v3/projects/bc9741bf1f6e477b801ed8b81b565e67` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:18.496369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9741bf1f6e477b801ed8b81b565e67)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:18.499585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:18.578615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:18.586615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9741bf1f6e477b801ed8b81b565e67', 'request_id': 'req-4f02a052-0533-4fc5-a68a-05c0e6905ce2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:18.599009 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9741bf1f6e477b801ed8b81b565e67', 'request_id': 'req-4f02a052-0533-4fc5-a68a-05c0e6905ce2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:18.610139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9741bf1f6e477b801ed8b81b565e67', 'request_id': 'req-4f02a052-0533-4fc5-a68a-05c0e6905ce2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:18.633807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] The token cache is being invalidate because project bc9741bf1f6e477b801ed8b81b565e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:18.634763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:18.635774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4f02a052-0533-4fc5-a68a-05c0e6905ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:18.641101 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1250/2476] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:18 2022] DELETE /identity/v3/projects/bc9741bf1f6e477b801ed8b81b565e67 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:17:18.642399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:18.642909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:18.643024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:18.666127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:18.667501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:18.747971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1227/2477] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:18.756372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:18.756673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:18.756955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:18.789719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:18.791319 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:18.806184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1251/2478] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:18.811215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:18.829457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106bd4-8904-429e-b221-0d272c830414 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:18.834315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:18.839293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:18.839900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:18.840403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:18.841399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:17:18.842980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:18.845242 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:18.879984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:18.884802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1228/2479] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:17:18.891142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66f97-5894-4367-b8a7-7bafa9ea07a5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:18.897103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:18.897848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:18.898196 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:18.898644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:18.899570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:18.901423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76656-c3c0-453b-9794-10f2a2b99399 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:18.940028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1252/2480] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:17:18 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:17:18.945606 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:18.957652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9462-87f9-470b-badf-f34cc08ef6ca admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.100021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.100822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.101209 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.101596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.102409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.104990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.118621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.119431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.119431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.121986 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:19.150018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1229/2481] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:17:18 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:17:19.151001 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:19.152472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:19.154172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:19.170070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed8a4-e8ce-49c4-8740-786af2b57c56 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.193817 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.195378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.195790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.196164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.197034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.199013 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.213027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1230/2482] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:19.219315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:19.234822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c6-a3ed-42cc-97f3-c95b06ebfb5d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.245851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.249345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.249345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.249643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.255963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.257778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.279454 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1231/2483] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:17:19.282559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:19.300536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1253/2484] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:19.310655 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26f6ee-0b4c-4d28-ac38-666589f53842 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.316468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:19.318817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:19.329232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.329939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.330229 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.330530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] PATH_INFO: `/v3/projects/7f80e6a0d102408197e535aee87f57a9/users/a3fc3b34db744ee8b28ef3fdf8d870ac/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.354023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f80e6a0d102408197e535aee87f57a9, user_id=a3fc3b34db744ee8b28ef3fdf8d870ac, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.356794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffcabc-2868-4ce6-ba14-adc5dbf235ff admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.402983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1232/2485] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:17:19 2022] PUT /identity/v3/projects/7f80e6a0d102408197e535aee87f57a9/users/a3fc3b34db744ee8b28ef3fdf8d870ac/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:19.414398 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.414735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.419595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.467614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] MFA Rules not processed for user `a3fc3b34db744ee8b28ef3fdf8d870ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:19.469343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:19.477175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497ffe-853b-46f5-b0ea-8bf99be7d5c5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.563892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:19.566877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1233/2486] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:19.576983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:19.578824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:19.585970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.586936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.587868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.588376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.659033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d8e36-546f-425a-8ba4-f2bfaab71ef4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:19.663365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:19.664020 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:19.664330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:19.664602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:19.674078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.674332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:19.675726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae30c-db6c-48e1-8720-f4aaba2899ee service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.677023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:19.687841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1254/2487] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:17:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:19.696334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1234/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:17:29.682726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=30 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:29.683315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:32.004207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:32.104475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88257f-77e1-4833-a15b-0a2cd93f5357 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:32.109899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:32.110627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:32.110909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:32.111519 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] PATH_INFO: `/v3/users/a3fc3b34db744ee8b28ef3fdf8d870ac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:32.112471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fc3b34db744ee8b28ef3fdf8d870ac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:32.114527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:32.180135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fc3b34db744ee8b28ef3fdf8d870ac'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.180905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fc3b34db744ee8b28ef3fdf8d870ac'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.197158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fc3b34db744ee8b28ef3fdf8d870ac'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.206133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fc3b34db744ee8b28ef3fdf8d870ac'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.207574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fc3b34db744ee8b28ef3fdf8d870ac'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.225002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1255/2489] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:17:32 2022] DELETE /identity/v3/users/a3fc3b34db744ee8b28ef3fdf8d870ac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:32.229657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:32.230580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:32.230861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:32.252483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:32.253738 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:32.325498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1235/2490] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:32.336852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:32.338770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:32.415357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfa31a-9f7f-496f-b98e-03c019f5cd0b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:32.420048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:32.420690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:32.420975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:32.421308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:32.431467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:32.432929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:32.444674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1256/2491] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:17:32.737811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:32.740103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:32.760581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c066-bed0-42b1-a77e-a2ecc8f55f4f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:32.766762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:32.767437 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:32.767744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:32.768003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] PATH_INFO: `/v3/projects/7f80e6a0d102408197e535aee87f57a9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:32.769204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f80e6a0d102408197e535aee87f57a9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:32.772064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:32.825393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f80e6a0d102408197e535aee87f57a9', 'request_id': 'req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.833714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f80e6a0d102408197e535aee87f57a9', 'request_id': 'req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.840473 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f80e6a0d102408197e535aee87f57a9', 'request_id': 'req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.852605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] The token cache is being invalidate because project 7f80e6a0d102408197e535aee87f57a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:17:32.852897 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.853567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2ed25504-6c29-4e2c-80f6-6fcbd3b2450a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:17:32.855141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1236/2492] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:17:32 2022] DELETE /identity/v3/projects/7f80e6a0d102408197e535aee87f57a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:17:35.703955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:35.705450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:35.717303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbeed2-75c1-4265-aea2-0e8e9c7515a6 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:35.738043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:35.772413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:35.773034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:35.773324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:35.773617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:35.775404 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:35.785653 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:35.787119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:35.795266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1257/2493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:17:37.842908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d121f-54eb-49a6-a7a2-cb86aecd3f57 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:37.843712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d121f-54eb-49a6-a7a2-cb86aecd3f57 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:37.843712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d121f-54eb-49a6-a7a2-cb86aecd3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:37.864612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4a2d121f-54eb-49a6-a7a2-cb86aecd3f57 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:37.865868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4a2d121f-54eb-49a6-a7a2-cb86aecd3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:37.927925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1237/2494] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:17:37.939944 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:37.941402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:38.013084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dbb68-bf9e-4091-aae9-b48a31d8caa1 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:38.017983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:38.018634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:38.018918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:38.019193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:38.027537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:38.029124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:38.037622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1258/2495] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:47.920652 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:48.033882 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=48 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:53.807534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:53.808111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:53.808512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:53.841053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:17:53.842339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:17:53.852114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1238/2496] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:17:53.880841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:17:53.891973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6497-fa1c-416b-ae8e-ad5b0a2f2332 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:17:53.898079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:17:53.898763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:17:53.899043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:17:53.899312 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:17:53.912907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:17:53.914614 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:17:53.925154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1259/2497] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:18:00.336021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:00.337615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:00.351341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0e33-cb34-4adf-aec8-3c53653d5f20 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:00.355616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:00.356375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:00.356764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:00.357133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:00.359299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:00.448444 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:00.451244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:00.468552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1239/2498] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:01.935052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:01.937119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:02.024224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2a5f-6c75-45fc-ae9e-c970722b18aa service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:02.030156 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:02.030859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:02.031337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:02.031626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:02.033674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:02.118675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:02.120335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:02.131242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1260/2499] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:04.428036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:04.429534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:04.552918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:04.555365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:04.558128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e74a-036b-4f4f-8197-5a9eb46cccac service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:04.569269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:04.570104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:04.570527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:04.570872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:04.571611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8490cdc-c461-4565-ba07-33e5bf895d95 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:04.573217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:04.576557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:04.577303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:04.577668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:04.578046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] PATH_INFO: `/v3/users/e7566583228946488bd1ab647bbe8059` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:04.579412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7566583228946488bd1ab647bbe8059)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:04.581435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:04.588345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:04.590282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:04.603727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1240/2500] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:04.654693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7566583228946488bd1ab647bbe8059'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:04.655884 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7566583228946488bd1ab647bbe8059'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:04.673676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7566583228946488bd1ab647bbe8059'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:04.682466 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7566583228946488bd1ab647bbe8059'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:04.683281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0ed94fa2-59ac-4585-9c9e-7ddafb2c65c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7566583228946488bd1ab647bbe8059'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:04.687370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:04.702384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1261/2501] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:04 2022] DELETE /identity/v3/users/e7566583228946488bd1ab647bbe8059 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:04.901436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:04.914165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee982a-1bb8-478c-b2ed-91810a416636 service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:04.990869 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:04.991483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:04.991753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:04.992036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] PATH_INFO: `/v3/projects/04bd0b93ac8140559e3ddfe51cc2cdaf` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:04.993306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bd0b93ac8140559e3ddfe51cc2cdaf)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:04.995287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.018090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:05.049570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'request_id': 'req-1d68cff9-f23a-41f4-8919-1d34692a5419'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:05.062281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'request_id': 'req-1d68cff9-f23a-41f4-8919-1d34692a5419'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:05.072781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'request_id': 'req-1d68cff9-f23a-41f4-8919-1d34692a5419'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:05.090650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] The token cache is being invalidate because project 04bd0b93ac8140559e3ddfe51cc2cdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:05.090954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:05.091730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-1d68cff9-f23a-41f4-8919-1d34692a5419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:05.093689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1241/2502] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:04 2022] DELETE /identity/v3/projects/04bd0b93ac8140559e3ddfe51cc2cdaf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:05.099774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.100041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.100323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.121545 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:05.123417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:05.213471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1262/2503] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:05.219082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.219592 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.220094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.254571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:05.255938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:05.265683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1242/2504] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:05.271105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.281333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6672-df92-4485-a447-668c8cde3742 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.286699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.287357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.287637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.287913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.288661 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:05.288963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.290620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.304348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1263/2505] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:05.309458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.324919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e6d6d-1dce-4151-bd27-18d0b9d2416f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.330004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.330716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.331006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.331287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.332533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.334498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.372691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1243/2506] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:05 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:05.377832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.389215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff083-1d81-4be4-9427-9bd7d28a3b7b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.454624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.455190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.455478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.455759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.456452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.458752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.481556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1264/2507] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:05 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:05.485760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.497753 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d8ca-7adc-40dc-8aaa-d7efeb486c7b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.502629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.503260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.503581 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.503911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.504611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.506241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.516873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1244/2508] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:05.521373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.532064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1c6f5-51ca-46ee-816f-6fb798e7dcf7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.537602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.538231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.538552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.538836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.539539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.541201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7553d-f48a-4f64-9370-be2ae60842bb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.553468 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1265/2509] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:05.557842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.568305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e966d5f-3279-4e2d-88dc-4ce28a272f88 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.573388 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.574072 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.574364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.574694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] PATH_INFO: `/v3/projects/b828cda2aeff4145869b56c4f34e57b9/users/f0130953a68d4d8c9a739d9eb3f666f1/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.591372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b828cda2aeff4145869b56c4f34e57b9, user_id=f0130953a68d4d8c9a739d9eb3f666f1, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.594278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.612563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1245/2510] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:05 2022] PUT /identity/v3/projects/b828cda2aeff4145869b56c4f34e57b9/users/f0130953a68d4d8c9a739d9eb3f666f1/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:05.623736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.624025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.624297 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.657337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] MFA Rules not processed for user `f0130953a68d4d8c9a739d9eb3f666f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:05.658627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:05.731363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:05.767097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1266/2511] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:05.779281 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:05.781074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:05.872131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833323c-fa7b-4206-9f9e-8674f7ce570d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:05.877905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:05.878582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:05.878907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:05.879184 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:05.888520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:05.890208 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9617877-2ef4-44fd-93d8-70f45448a3ca service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:05.900922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1246/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:13.411843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:13.494244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a190-42f5-4e5e-a846-2f21b7dd827f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:13.499086 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:13.499774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:13.500082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:13.500363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] PATH_INFO: `/v3/users/f0130953a68d4d8c9a739d9eb3f666f1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:13.501717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0130953a68d4d8c9a739d9eb3f666f1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:13.503723 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:13.574406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0130953a68d4d8c9a739d9eb3f666f1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:13.575195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0130953a68d4d8c9a739d9eb3f666f1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:13.594630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0130953a68d4d8c9a739d9eb3f666f1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:13.606597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0130953a68d4d8c9a739d9eb3f666f1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:13.619797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0130953a68d4d8c9a739d9eb3f666f1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:13.627392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1267/2513] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:13 2022] DELETE /identity/v3/users/f0130953a68d4d8c9a739d9eb3f666f1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:13.631253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:13.631925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:13.631925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:13.654327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:13.655655 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:13.689963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:13.733560 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1247/2514] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:13.743482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:13.744923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:13.809794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d063e5-6725-424d-8fa0-583b40deff62 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:13.815402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:13.816609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:13.817490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:13.817985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:13.835243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:13.836769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641159b9-5e3e-4b3e-a415-950e8a3a6803 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:13.847803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1268/2515] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:14.151276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.152821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:14.172045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332a01-3ce2-4888-b453-270dbab17707 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.178021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.187262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.187565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.187852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] PATH_INFO: `/v3/projects/b828cda2aeff4145869b56c4f34e57b9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.189325 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b828cda2aeff4145869b56c4f34e57b9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.191335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.242953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b828cda2aeff4145869b56c4f34e57b9', 'request_id': 'req-6d959486-a02e-4e42-bea9-5176ef34c9a6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:14.250963 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b828cda2aeff4145869b56c4f34e57b9', 'request_id': 'req-6d959486-a02e-4e42-bea9-5176ef34c9a6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:14.257582 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b828cda2aeff4145869b56c4f34e57b9', 'request_id': 'req-6d959486-a02e-4e42-bea9-5176ef34c9a6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:14.270624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] The token cache is being invalidate because project b828cda2aeff4145869b56c4f34e57b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:14.271060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:14.271972 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6d959486-a02e-4e42-bea9-5176ef34c9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:14.273687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1248/2516] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:14 2022] DELETE /identity/v3/projects/b828cda2aeff4145869b56c4f34e57b9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:14.278767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.279064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.279350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.300654 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:14.301887 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:14.311030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:14.371712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1269/2517] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:14.381579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.381866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.382167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.404286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:14.405558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:14.414562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1249/2518] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:14.419108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.429214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71a7bb-d6ff-42b9-86fa-a22f1c6f60ef None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.434783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.435648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.436082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.436461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.437192 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:14.437503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.439207 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.453097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1270/2519] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:14.458228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.467898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6de4-72f8-419a-9f1e-a6a74e40b087 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.472864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.473567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.473875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.474156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.474891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.477064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.509101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1250/2520] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:14 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:14.513349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.524941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd142bef-a69c-40b7-9b59-72380b2fe65d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.585705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.586345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.586658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.586945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.587627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.589650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.612152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1271/2521] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:14 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:14.616725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.627709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e0a1-0ca2-43ba-a259-d91667127fc5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.633251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.633877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.634163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.634459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.635166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.637007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.651689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1251/2522] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:14.656333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.668731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181639a5-668d-4163-90f8-1b92dcaa2152 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.674386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.675194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.675577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.676064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.676989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.679382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff69148-7aa9-478b-9a31-0de21acffee6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.698038 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1272/2523] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:14.708852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.710886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e1f2-6557-4d3c-a4c6-52d0b72d1732 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.718286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.719687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.719965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.720254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] PATH_INFO: `/v3/projects/5a6de667981345d0bc684fda2eb97d48/users/9422509d12354408a8364cf5c6094cff/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.735797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6de667981345d0bc684fda2eb97d48, user_id=9422509d12354408a8364cf5c6094cff, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.738524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.752839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1252/2524] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:14 2022] PUT /identity/v3/projects/5a6de667981345d0bc684fda2eb97d48/users/9422509d12354408a8364cf5c6094cff/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:14.765544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.769829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.769829 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.800115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] MFA Rules not processed for user `9422509d12354408a8364cf5c6094cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:14.801855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:14.868140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1273/2525] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:14.879297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:14.881639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:14.939070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:14.943872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651263c-e44e-407f-b348-d98f340f8356 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:14.948479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:14.949527 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:14.949902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:14.950197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:14.960071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:14.961559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f224afe-3175-46f5-a3ff-f14670ffed87 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:14.971005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1253/2526] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:23.592626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:23.602686 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:23.657268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ba91-4cee-4d46-9d08-45f98a309cc5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:23.662340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:23.663032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:23.663321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:23.663603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] PATH_INFO: `/v3/users/9422509d12354408a8364cf5c6094cff` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:23.664777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9422509d12354408a8364cf5c6094cff)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:23.667144 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:23.714961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9422509d12354408a8364cf5c6094cff'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:23.715711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9422509d12354408a8364cf5c6094cff'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:23.728050 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9422509d12354408a8364cf5c6094cff'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:23.735743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9422509d12354408a8364cf5c6094cff'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:23.736484 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9422509d12354408a8364cf5c6094cff'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:23.751817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1274/2527] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:23 2022] DELETE /identity/v3/users/9422509d12354408a8364cf5c6094cff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:23.757795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:23.758306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:23.758772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:23.778953 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:23.780150 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:23.838363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1254/2528] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:23.848134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:23.849548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:23.906815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821ed0-9ef6-4417-a7db-937a108b2276 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:23.910503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:23.911133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:23.911416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:23.911687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:23.920971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:23.922405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a356219-2e44-4c3b-98ef-66321ecea572 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:23.932724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1275/2529] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:24.234234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.235924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:24.262108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11efc9-9fda-415e-bf54-3ebbd4fa9f37 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.270010 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.270919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.271260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.271571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] PATH_INFO: `/v3/projects/5a6de667981345d0bc684fda2eb97d48` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.273206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6de667981345d0bc684fda2eb97d48)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.275651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.330677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6de667981345d0bc684fda2eb97d48', 'request_id': 'req-a0b47d16-5210-4cab-a07c-4c079f0c5325'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:24.338509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6de667981345d0bc684fda2eb97d48', 'request_id': 'req-a0b47d16-5210-4cab-a07c-4c079f0c5325'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:24.344980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6de667981345d0bc684fda2eb97d48', 'request_id': 'req-a0b47d16-5210-4cab-a07c-4c079f0c5325'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:24.357530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] The token cache is being invalidate because project 5a6de667981345d0bc684fda2eb97d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:24.357932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:24.358993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a0b47d16-5210-4cab-a07c-4c079f0c5325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:24.365660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1255/2530] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:24 2022] DELETE /identity/v3/projects/5a6de667981345d0bc684fda2eb97d48 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:24.367642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.367642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.368034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.392352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:24.393579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:24.422293 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:24.468490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1276/2531] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:24.477498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.477790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.478134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.500851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:24.502198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:24.511323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1256/2532] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:24.515902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.526492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901f5cc-de09-4541-9f54-88fc629baf4c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.531397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.531959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.532405 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.532681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.533463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:24.533732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.536249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.548252 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1277/2533] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:24.553239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.563648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554219-e835-4779-99fa-5efe6c6b9c2f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.568040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.568686 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.568995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.569278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.569961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.572051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.604705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1257/2534] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:24.609077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.620354 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad65c03-6df7-4535-a8b2-fe94bfeba424 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.689044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.689677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.689965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.690248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.690967 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.692941 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.716540 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1278/2535] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:24.722191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.733517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4b77-2f53-4a8d-835e-0a706ac6e5b3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.738363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.739113 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.739352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.739637 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.740338 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.741941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.752830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1258/2536] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:24.756632 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.767350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f54eb4-5caf-4aa4-a55b-de54fa55d908 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.773244 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.773867 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.774158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.774618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.775325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.776948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836ea26-4a91-4fef-88ca-e7ef2d4a62b6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.791955 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1279/2537] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:24.793007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.803180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6a919-f545-40b4-86d9-81799034eb7f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:24.807866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:24.808534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.808823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.809107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] PATH_INFO: `/v3/projects/790d405b99d9498d812d21ad07d1f978/users/358b40ac95394faf8336a37c19920abe/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.823482 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790d405b99d9498d812d21ad07d1f978, user_id=358b40ac95394faf8336a37c19920abe, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:24.826140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:24.839425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1259/2538] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:24 2022] PUT /identity/v3/projects/790d405b99d9498d812d21ad07d1f978/users/358b40ac95394faf8336a37c19920abe/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:24.850136 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:24.850434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:24.850747 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:24.879145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] MFA Rules not processed for user `358b40ac95394faf8336a37c19920abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:24.880373 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:24.944873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1280/2539] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:24.949416 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:24.962737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:25.012006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed0ad-c4f2-4e58-9efd-c77a7b27d593 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.016605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.017222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.017509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.017784 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.018450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.021236 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.047157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1260/2540] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:25.051234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.063433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460369-1b88-4d2d-bd90-f256076a4c85 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.089729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:25.122744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.123379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.123662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.123938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.124604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.126549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.149536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1281/2541] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:25 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:25.153851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.164692 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da78b69-0516-46ac-8c2c-c890f364964f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.169729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.170372 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.170853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.171064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.171706 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.173376 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.184657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1261/2542] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:25.188902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.199579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aada3-4997-4605-8754-8880bc56164a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.204304 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.204982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.205271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.205553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] PATH_INFO: `/v3/projects/e6b11edf8eab4899bd52aca72b398906/users/932d19126d684d11b132858437345443/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.221668 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b11edf8eab4899bd52aca72b398906, user_id=932d19126d684d11b132858437345443, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.224417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.239391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1282/2543] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:25 2022] PUT /identity/v3/projects/e6b11edf8eab4899bd52aca72b398906/users/932d19126d684d11b132858437345443/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:25.243602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.254834 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c75bba-9e48-44ab-b916-fdb407fe98e9 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.314164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.314884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.315280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.315744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.317969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.320566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cafaf-ff89-45bb-9a6e-a7ba173db7c7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.332657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1262/2544] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:25.336943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.347453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76621d6-007f-4b3a-9054-f1b23482c91f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.352148 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.352826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.353111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.353391 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] PATH_INFO: `/v3/projects/e6b11edf8eab4899bd52aca72b398906/users/932d19126d684d11b132858437345443/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.355450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b11edf8eab4899bd52aca72b398906, user_id=932d19126d684d11b132858437345443, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.358097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.369284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1283/2545] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:25 2022] PUT /identity/v3/projects/e6b11edf8eab4899bd52aca72b398906/users/932d19126d684d11b132858437345443/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:25.380816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.381303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.381624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.410901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] MFA Rules not processed for user `932d19126d684d11b132858437345443`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:25.412132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:25.483278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1263/2546] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:25.495611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.497458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:25.561234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7982f7-a207-4de0-b2fe-35080205b3cc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.565072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.565634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.565919 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.566199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.577117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.578592 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67347c2-32e7-428c-8960-b1a6af3593f9 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.588441 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1284/2547] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:25.657078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.666642 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:25.724728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086f96b-6a13-4ad4-aef1-4aa6c470c590 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:25.729524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:25.730179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.730512 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.731199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] PATH_INFO: `/v3/users/358b40ac95394faf8336a37c19920abe` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.732671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358b40ac95394faf8336a37c19920abe)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:25.734916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:25.787412 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358b40ac95394faf8336a37c19920abe'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:25.794513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358b40ac95394faf8336a37c19920abe'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:25.808542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358b40ac95394faf8336a37c19920abe'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:25.819023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358b40ac95394faf8336a37c19920abe'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:25.819647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358b40ac95394faf8336a37c19920abe'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:25.828270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1264/2548] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:25 2022] DELETE /identity/v3/users/358b40ac95394faf8336a37c19920abe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:25.832983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:25.833539 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:25.833622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:25.854609 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:25.855929 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:25.923363 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1285/2549] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:25.933940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:25.935563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:26.004311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd914-60b9-4dbf-a306-ef867cd923b1 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:26.008914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:26.009566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:26.009841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:26.010130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:26.022644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:26.024145 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:26.034620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1265/2550] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:26.349551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:26.352372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:26.370259 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6f52-f3fd-41dd-a4f4-78292f959316 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:26.375767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:26.376445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:26.376731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:26.377013 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] PATH_INFO: `/v3/projects/790d405b99d9498d812d21ad07d1f978` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:26.378272 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790d405b99d9498d812d21ad07d1f978)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:26.381695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:26.405506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:26.446002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790d405b99d9498d812d21ad07d1f978', 'request_id': 'req-b47c8a20-3aad-4ae6-babf-0fd906067ea9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.453011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790d405b99d9498d812d21ad07d1f978', 'request_id': 'req-b47c8a20-3aad-4ae6-babf-0fd906067ea9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.460676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790d405b99d9498d812d21ad07d1f978', 'request_id': 'req-b47c8a20-3aad-4ae6-babf-0fd906067ea9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.476813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] The token cache is being invalidate because project 790d405b99d9498d812d21ad07d1f978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:26.476813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.480200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.486164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1286/2551] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:26 2022] DELETE /identity/v3/projects/790d405b99d9498d812d21ad07d1f978 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:26.497397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:26.508735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e66-c74e-43f9-af3b-f9ceb6d64c0f service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:26.545186 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:26.583330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:26.584332 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:26.584716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:26.585093 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] PATH_INFO: `/v3/users/932d19126d684d11b132858437345443` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:26.586479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=932d19126d684d11b132858437345443)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:26.588503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:26.643235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932d19126d684d11b132858437345443'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.651870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932d19126d684d11b132858437345443'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.672776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932d19126d684d11b132858437345443'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.685775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932d19126d684d11b132858437345443'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.686936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-832a301e-ad05-4487-ae58-5b61ddeb1faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932d19126d684d11b132858437345443'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:26.696386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1266/2552] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:26 2022] DELETE /identity/v3/users/932d19126d684d11b132858437345443 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:27.028627 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.030116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:27.044871 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8a20-3aad-4ae6-babf-0fd906067ea9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.129675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.130729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.131082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.131458 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] PATH_INFO: `/v3/projects/e6b11edf8eab4899bd52aca72b398906` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.133489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b11edf8eab4899bd52aca72b398906)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.136524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.187675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b11edf8eab4899bd52aca72b398906', 'request_id': 'req-9af959df-d644-4b2a-a27a-1be0115359a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:27.194188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b11edf8eab4899bd52aca72b398906', 'request_id': 'req-9af959df-d644-4b2a-a27a-1be0115359a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:27.200925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b11edf8eab4899bd52aca72b398906', 'request_id': 'req-9af959df-d644-4b2a-a27a-1be0115359a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:27.215780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] The token cache is being invalidate because project e6b11edf8eab4899bd52aca72b398906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:27.216221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:27.217211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9af959df-d644-4b2a-a27a-1be0115359a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:27.219077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1287/2553] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:27 2022] DELETE /identity/v3/projects/e6b11edf8eab4899bd52aca72b398906 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:27.225468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.226012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.226012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.249170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:27.250694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:27.406548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1267/2554] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:27.417564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.419172 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.419908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.454254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:27.457549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:27.478786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1288/2555] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:27.486410 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.510117 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32970a74-6043-48cc-be1b-a8553f779401 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.521880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.523342 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.523794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.524194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.525590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:27.526493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.528487 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.551577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1268/2556] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:27.553411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.569985 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107bbd8-60e6-4db2-8a19-ac76e5187069 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.580737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.581397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.581684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.581964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.583273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.585278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.636798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1289/2557] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:27 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:27.642122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.654611 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2681bf0-e91f-4b00-bcba-362a59ccf57b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.692198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:27.731241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.731881 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.732167 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.732450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.733125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.735132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.759413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1269/2558] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:27 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:27.765100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.781010 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fed9-6ea0-415b-ba77-6ef529e6fa94 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.795420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.796667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.797160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.797656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.799067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.802253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.804989 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:27.821731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.822329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1290/2559] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:27.833762 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfffd3-13cb-4564-8ec9-3df3cf1a799f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.838915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.839533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.839816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.840100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.840811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.842479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8de497-ef2f-4e7f-9a67-1caa2324d14d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.862523 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1270/2560] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:27.865769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:27.878808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8ecc-3ef0-417b-9e82-2fcb52625e44 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:27.884193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:27.884996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.885321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.885700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] PATH_INFO: `/v3/projects/9cd64eeb2b1046cd9e41c90494f9aa7a/users/ff53a8c657c54451bef48439a70d59e5/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.905821 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd64eeb2b1046cd9e41c90494f9aa7a, user_id=ff53a8c657c54451bef48439a70d59e5, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:27.908582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:27.930100 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1291/2561] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:27 2022] PUT /identity/v3/projects/9cd64eeb2b1046cd9e41c90494f9aa7a/users/ff53a8c657c54451bef48439a70d59e5/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:27.933034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d087-e7b3-4651-86fe-ec57bafe46a1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:27.933335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d087-e7b3-4651-86fe-ec57bafe46a1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:27.933871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443d087-e7b3-4651-86fe-ec57bafe46a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:27.965277 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3443d087-e7b3-4651-86fe-ec57bafe46a1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:27.966657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3443d087-e7b3-4651-86fe-ec57bafe46a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:28.040479 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1271/2562] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:28.051722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:28.055056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:28.128872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dd03a-fa1e-4a73-a59b-42ec1f59e65b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:28.135416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:28.136111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:28.136380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:28.136670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:28.157611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:28.162287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:28.173951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1292/2563] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:29.100688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242d52-1d49-4a45-be38-352583439252 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.101302 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242d52-1d49-4a45-be38-352583439252 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.101785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242d52-1d49-4a45-be38-352583439252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.166282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-37242d52-1d49-4a45-be38-352583439252 None None] MFA Rules not processed for user `ff53a8c657c54451bef48439a70d59e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:29.167862 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-37242d52-1d49-4a45-be38-352583439252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:29.268723 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1272/2564] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:29.272957 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.284158 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3cb0-6b57-4f79-a315-3932c9b05fee service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.291247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.292597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.293081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.293362 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.294070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.297229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.356409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1293/2565] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:29 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:29.362931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37242d52-1d49-4a45-be38-352583439252 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.379096 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37242d52-1d49-4a45-be38-352583439252 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.440693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:29.460235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.461493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.462039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.462346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.463024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.465132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.497049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1273/2566] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:29 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:29.499143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.519532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ef91-3883-48b0-9ce5-486d18a1221d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.529524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.530663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.531180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.531669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.532994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.535827 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.550762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1294/2567] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:29.556561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.573215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d770-2f74-4d11-8a7d-d7d4292ce0af admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.578255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.578980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.579271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.579561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] PATH_INFO: `/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134/users/2ad2f557856b4dda80951650bb7e1605/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.597461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3950e2cf2df4cbf94a60ada0beb1134, user_id=2ad2f557856b4dda80951650bb7e1605, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.599733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.614286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1274/2568] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:29 2022] PUT /identity/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134/users/2ad2f557856b4dda80951650bb7e1605/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:29.618299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.628561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85059f5c-b207-4b1e-bd88-86b4cc65cb64 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.696027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.696673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.697058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.697408 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.698205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.700079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315ec3a-5369-48d1-86d3-a84d4221320a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.712384 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1295/2569] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:29.717752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:29.729989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85abcc-ec09-4e6c-9f7b-75b67d623838 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:29.735077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:29.735777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:29.736060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:29.736344 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] PATH_INFO: `/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134/users/2ad2f557856b4dda80951650bb7e1605/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:29.738559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3950e2cf2df4cbf94a60ada0beb1134, user_id=2ad2f557856b4dda80951650bb7e1605, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:29.741805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:29.755576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1275/2570] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:29 2022] PUT /identity/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134/users/2ad2f557856b4dda80951650bb7e1605/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:30.464247 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:30.464824 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:30.464987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:30.504407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] MFA Rules not processed for user `2ad2f557856b4dda80951650bb7e1605`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:30.505663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:30.543873 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:30.630063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1296/2571] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:30.652558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:30.654286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:30.732588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e446f8-351a-460e-bdd3-6cbf2f16ccda admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:30.740044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:30.740700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:30.741031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:30.742042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:30.844295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:30.845722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:30.857982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1276/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:32.292124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:32.302140 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e827-1678-46aa-a13c-75b9325f0f71 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:32.305743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:32.306385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:32.306718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:32.306995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:32.316434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:32.318015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:32.330835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1297/2573] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:33.157551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:33.221506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66773b-c779-4c5d-8ecf-99d56be8d829 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:33.225883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:33.226570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:33.226865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:33.227137 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:33.228996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:33.234223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:33.307099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:33.308878 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:33.324000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1277/2574] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:36.568886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:36.571447 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:36.587634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d56d-a50b-41c8-b01f-9f9822f358fb service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:36.596347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:36.597243 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:36.597793 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:36.599294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:36.605556 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:36.628230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:36.630639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:36.654406 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1298/2575] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:36.806732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:36.808870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:36.833791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7d55-ca16-4cf8-8acc-6cc99ee9d06f service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:36.840104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:36.840780 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:36.841243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:36.841708 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] PATH_INFO: `/v3/users/023c699e0cac426f8e7229ebbb7727b7` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:36.843565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023c699e0cac426f8e7229ebbb7727b7)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:36.845594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:36.935564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023c699e0cac426f8e7229ebbb7727b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:36.966118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023c699e0cac426f8e7229ebbb7727b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:36.999811 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023c699e0cac426f8e7229ebbb7727b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.014917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023c699e0cac426f8e7229ebbb7727b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.021942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8c7925db-34a6-4352-8c07-006e3dfcced2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023c699e0cac426f8e7229ebbb7727b7'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.034997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1278/2576] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:36 2022] DELETE /identity/v3/users/023c699e0cac426f8e7229ebbb7727b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:37.227416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:37.239699 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df36a9-2f4a-409c-821f-1f16bf5438e5 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:37.318639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:37.319306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.319713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.320012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] PATH_INFO: `/v3/projects/8bf1655c29144bb2a7d925a5a5b22bdb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.321279 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf1655c29144bb2a7d925a5a5b22bdb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:37.323287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:37.405499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf1655c29144bb2a7d925a5a5b22bdb', 'request_id': 'req-13e3756a-cb6b-4316-bb64-2a163bda2efa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.417205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf1655c29144bb2a7d925a5a5b22bdb', 'request_id': 'req-13e3756a-cb6b-4316-bb64-2a163bda2efa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.429378 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf1655c29144bb2a7d925a5a5b22bdb', 'request_id': 'req-13e3756a-cb6b-4316-bb64-2a163bda2efa'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.447124 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] The token cache is being invalidate because project 8bf1655c29144bb2a7d925a5a5b22bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:37.447443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.448131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-13e3756a-cb6b-4316-bb64-2a163bda2efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:37.450033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1299/2577] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:37 2022] DELETE /identity/v3/projects/8bf1655c29144bb2a7d925a5a5b22bdb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:37.454918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.455214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.455503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.485156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:37.487348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:37.560406 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1279/2578] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:37.569308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.569968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.569968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.591462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:37.592721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:37.602014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1300/2579] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:37.606913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:37.618104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df851d7-2ed0-41aa-9d8b-973d2e2f6bee None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:37.623934 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:37.624595 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.624879 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.625255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.626369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:37.626870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:37.628574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:37.649633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:37.655451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1280/2580] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:37.661570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:37.687565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8ea0d-3897-41e5-95f4-dacb11b28141 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:37.694470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:37.695133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.695427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.695711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.696413 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:37.698493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:37.729242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:37.752176 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1301/2581] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:37 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:37.756430 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:37.775942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022073d-bc40-4bf1-877b-2d59c22221f3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:37.881122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:37.882369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.883029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.883558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.884941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:37.889227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:37.930838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1281/2582] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:37 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:37.932438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:37.954183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b3ce-6e17-4959-a66d-fde213e0eedd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:37.964685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:37.965346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:37.965630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:37.965909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:37.966733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:37.968396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:37.982061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1302/2583] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:37.985868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.018726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25a6c-4784-4997-8cfd-d824471ea71c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.024997 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.025648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.025946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.026231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.027120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.029308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010321fc-5b58-4629-9679-388aa97bd04c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.042864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1282/2584] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:38.047248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.060862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871872d-7b44-42b8-8342-cd3a5ef520d0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.068346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.069074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.069357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.069635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] PATH_INFO: `/v3/projects/d73bcbac6ffb4d35bbf7a07d7044c3ac/users/211ce24ca09446d6ab14899572d62e6a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.090677 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73bcbac6ffb4d35bbf7a07d7044c3ac, user_id=211ce24ca09446d6ab14899572d62e6a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.095977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.118567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1303/2585] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:38 2022] PUT /identity/v3/projects/d73bcbac6ffb4d35bbf7a07d7044c3ac/users/211ce24ca09446d6ab14899572d62e6a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:38.130893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.131307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.131568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.171626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] MFA Rules not processed for user `211ce24ca09446d6ab14899572d62e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:38.173922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:38.274596 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1283/2586] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:38.279409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.371369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b986-d6a3-4758-a457-1ebad0aca921 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.376773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.377424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.377717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.377997 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.378717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.381471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.416199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1304/2587] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:38 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:38.417436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.429737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed93a-031a-489b-849d-bf1220e9e9ca None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.505318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.506067 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.506305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.506620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.507348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.509531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.528601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:38.535810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1284/2588] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:38 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:38.539974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.551321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035dcde-329c-4fa1-ab8c-c5f353c134be admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.556306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.557059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.557410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.557693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.558476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.560154 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.706634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1305/2589] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:38.707858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.718785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900cc29-c06e-4476-8f2c-7cc562098c05 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.724265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.724956 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.725240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.725519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] PATH_INFO: `/v3/projects/2d674d51d4114af29d5b3999e59836a1/users/74e3bca122d24c3aa50a8c1d48ecdbe4/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.744393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d674d51d4114af29d5b3999e59836a1, user_id=74e3bca122d24c3aa50a8c1d48ecdbe4, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.748304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.773948 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1285/2590] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:38 2022] PUT /identity/v3/projects/2d674d51d4114af29d5b3999e59836a1/users/74e3bca122d24c3aa50a8c1d48ecdbe4/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:38.778851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.790784 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ef1e-6487-4239-8ede-a100fcaef7c1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.867135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.868284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.869173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.869173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.869912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.871902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188786b-a0df-4e00-9786-490e0375ecb2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.883855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1306/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:38.887965 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:38.900044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dccb76-d314-4746-a0ff-194a0034d5bf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:38.907097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:38.908185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.908185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.908464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] PATH_INFO: `/v3/projects/2d674d51d4114af29d5b3999e59836a1/users/74e3bca122d24c3aa50a8c1d48ecdbe4/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.912721 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d674d51d4114af29d5b3999e59836a1, user_id=74e3bca122d24c3aa50a8c1d48ecdbe4, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:38.914907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:38.929151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1286/2592] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:38 2022] PUT /identity/v3/projects/2d674d51d4114af29d5b3999e59836a1/users/74e3bca122d24c3aa50a8c1d48ecdbe4/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:38.941453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:38.941924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:38.942302 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:38.976399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] MFA Rules not processed for user `74e3bca122d24c3aa50a8c1d48ecdbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:38.977822 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:39.005216 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:39.069120 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1307/2593] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:39.080159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:39.083451 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:39.294472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4602-b2ef-4ca3-bd9e-b20cef06583f admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:39.300355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:39.301392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:39.301813 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:39.304809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:39.314778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:39.316858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:39.328033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1287/2594] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:40.662399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:40.664459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:40.743852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e18c8-d7ea-4cc9-b8b1-bc036fa56d78 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:40.748659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:40.749263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:40.749684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:40.750073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] PATH_INFO: `/v3/users/42ce2627c0f142f8892c182f69ef9a39` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:40.751412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ce2627c0f142f8892c182f69ef9a39)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:40.754826 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:40.833059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ce2627c0f142f8892c182f69ef9a39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:40.833059 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ce2627c0f142f8892c182f69ef9a39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:40.849638 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ce2627c0f142f8892c182f69ef9a39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:40.856134 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ce2627c0f142f8892c182f69ef9a39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:40.856976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-96552690-86db-4f3e-a963-dbc613e36c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ce2627c0f142f8892c182f69ef9a39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:40.871439 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1308/2595] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:40 2022] DELETE /identity/v3/users/42ce2627c0f142f8892c182f69ef9a39 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:41.125339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.137239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac84ea5-a53c-42e6-8f1d-f1dc512ee5d7 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.206597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.207385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.207705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.207987 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] PATH_INFO: `/v3/users/211ce24ca09446d6ab14899572d62e6a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.209391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=211ce24ca09446d6ab14899572d62e6a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.211409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.264011 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211ce24ca09446d6ab14899572d62e6a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.272389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211ce24ca09446d6ab14899572d62e6a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.281156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:41.288354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211ce24ca09446d6ab14899572d62e6a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.297977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211ce24ca09446d6ab14899572d62e6a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.298563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211ce24ca09446d6ab14899572d62e6a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.308622 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1288/2596] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:41 2022] DELETE /identity/v3/users/211ce24ca09446d6ab14899572d62e6a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:41.313278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785552-2109-441f-9004-2a13008721b4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.313689 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785552-2109-441f-9004-2a13008721b4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.314098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785552-2109-441f-9004-2a13008721b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.331330 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.335426 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.338305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ac785552-2109-441f-9004-2a13008721b4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:41.339634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac785552-2109-441f-9004-2a13008721b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.397878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:41.429167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1309/2597] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:41.430467 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7912d-c373-4925-8b5f-27342dd42a9d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.435462 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.436196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.436554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.436902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] PATH_INFO: `/v3/projects/fbbed7fab4584f379dbefe4af9826544` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.438214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbed7fab4584f379dbefe4af9826544)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.438991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785552-2109-441f-9004-2a13008721b4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.440161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.440393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac785552-2109-441f-9004-2a13008721b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.492238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbed7fab4584f379dbefe4af9826544', 'request_id': 'req-68cf5512-5477-45ed-b33d-0d402234c48c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.502950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbed7fab4584f379dbefe4af9826544', 'request_id': 'req-68cf5512-5477-45ed-b33d-0d402234c48c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.509486 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbed7fab4584f379dbefe4af9826544', 'request_id': 'req-68cf5512-5477-45ed-b33d-0d402234c48c'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.509673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785552-2109-441f-9004-2a13008721b4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.521644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] The token cache is being invalidate because project fbbed7fab4584f379dbefe4af9826544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:41.521944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.522661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-68cf5512-5477-45ed-b33d-0d402234c48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:41.524480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1289/2598] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:41 2022] DELETE /identity/v3/projects/fbbed7fab4584f379dbefe4af9826544 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:41.530063 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee58b4-137c-4ed9-8d99-e52a3fc9a259 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.530396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee58b4-137c-4ed9-8d99-e52a3fc9a259 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.530705 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee58b4-137c-4ed9-8d99-e52a3fc9a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.551709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9fee58b4-137c-4ed9-8d99-e52a3fc9a259 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:41.552824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9fee58b4-137c-4ed9-8d99-e52a3fc9a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.560816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.561443 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.561724 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.562424 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.563855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.614990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1290/2599] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:41.623447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.623815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.624154 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.646918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:41.647860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.648418 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.649448 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.657489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1291/2600] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:41.659819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1310/2601] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:41.662110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.672312 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e47c-cf47-4b4b-9eb1-c6d09c1f4f6f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.677760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.678390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.678713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.679770 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.680474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:41.680787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.682423 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.684386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:41.697600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1292/2602] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:41.703137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.713167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c40-cacc-42c5-b9fe-a280abe19266 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.719198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.719839 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.720127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.720410 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.721105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.723778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.756613 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1311/2603] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:41 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:41.761021 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.771748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4588ab-eda7-43e7-b00f-c4cc34cc8793 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.835489 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.836121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.836407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.836719 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.837440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.839440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.867000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1293/2604] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:41 2022] POST /identity/v3/users => generated 278 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:41.871030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.882197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45861835-911e-4684-aa83-15ce3a3bb87e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.887190 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.887810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.888095 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.888389 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.889080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.890697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.902859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1312/2605] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:41.907329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.918801 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7f3e-3e3c-4568-afd1-377f847f20cb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.923809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.924472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.924761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.925042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.925777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.927449 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.941885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1294/2606] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:41.943290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.957796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c45f5-ae70-4280-b025-0fa88d8fcbae admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.957971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:41.959905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:41.964647 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.965901 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.966183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.966705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] PATH_INFO: `/v3/projects/ed6565447a824f6fb9fada688ffa3fae/users/b1c68705d7f84bfdbdb12d4bc8a525ba/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.974036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92363bb7-fa0a-4991-8076-d5052c38c0a7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:41.977226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:41.982892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:41.983539 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:41.983835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:41.984299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] PATH_INFO: `/v3/projects/d73bcbac6ffb4d35bbf7a07d7044c3ac` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:41.986514 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73bcbac6ffb4d35bbf7a07d7044c3ac)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.989087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:41.990930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6565447a824f6fb9fada688ffa3fae, user_id=b1c68705d7f84bfdbdb12d4bc8a525ba, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:41.995269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4769f3d-4498-4297-a9cb-ad21287e5591 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.011185 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1313/2607] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:41 2022] PUT /identity/v3/projects/ed6565447a824f6fb9fada688ffa3fae/users/b1c68705d7f84bfdbdb12d4bc8a525ba/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:42.022180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.022514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.022875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.045638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73bcbac6ffb4d35bbf7a07d7044c3ac', 'request_id': 'req-a8950478-6de4-4816-8532-7909f3747e28'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.050890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] MFA Rules not processed for user `b1c68705d7f84bfdbdb12d4bc8a525ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:42.052152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.054516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73bcbac6ffb4d35bbf7a07d7044c3ac', 'request_id': 'req-a8950478-6de4-4816-8532-7909f3747e28'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.060247 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73bcbac6ffb4d35bbf7a07d7044c3ac', 'request_id': 'req-a8950478-6de4-4816-8532-7909f3747e28'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.074077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] The token cache is being invalidate because project d73bcbac6ffb4d35bbf7a07d7044c3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:42.074077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.074077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.075306 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1295/2608] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:41 2022] DELETE /identity/v3/projects/d73bcbac6ffb4d35bbf7a07d7044c3ac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:42.078936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.080808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.131278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1314/2609] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:42.135551 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.136973 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.155354 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:42.159358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8950478-6de4-4816-8532-7909f3747e28 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.168132 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.168802 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.169094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.169392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] PATH_INFO: `/v3/users/74e3bca122d24c3aa50a8c1d48ecdbe4` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.172160 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e3bca122d24c3aa50a8c1d48ecdbe4)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.176405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.216920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8273839-fb28-474f-a954-ecc8cadf5491 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.222809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.223445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.223737 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.224004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.224792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.226895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.239064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e3bca122d24c3aa50a8c1d48ecdbe4'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.249327 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e3bca122d24c3aa50a8c1d48ecdbe4'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.259409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1315/2610] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:42 2022] POST /identity/v3/projects => generated 355 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:42.263581 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.266168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e3bca122d24c3aa50a8c1d48ecdbe4'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.278153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e3bca122d24c3aa50a8c1d48ecdbe4'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.279106 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e3bca122d24c3aa50a8c1d48ecdbe4'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.287634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1296/2611] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:42 2022] DELETE /identity/v3/users/74e3bca122d24c3aa50a8c1d48ecdbe4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:42.350899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17222-6c77-4f7c-a56f-658f868bca66 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.357899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:42.444611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.445731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.446028 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.446323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.448284 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.451012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.480306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1316/2612] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:42 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:42.484825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.486295 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.502605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e01e6-a865-4ccd-9521-c2ea095fc36a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.509478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.510122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.510397 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.510740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.511422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.513039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.527311 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1297/2613] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:42.531604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.541765 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9dd4-43bf-4df2-9c7c-d0b3691ebba8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.546399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.547097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.547380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.548044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] PATH_INFO: `/v3/projects/6b63f403bbef4558891ced9230dbb448/users/6ccf852628f24211b63c06e40dbf369b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.563679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b63f403bbef4558891ced9230dbb448, user_id=6ccf852628f24211b63c06e40dbf369b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.566927 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.583567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1317/2614] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:42 2022] PUT /identity/v3/projects/6b63f403bbef4558891ced9230dbb448/users/6ccf852628f24211b63c06e40dbf369b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:42.587659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.601253 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f925fe-59bb-424d-bdf9-4b90f8a85354 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.664025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.666295 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.700265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.701266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.701900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.703039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.704576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.708464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.721854 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1298/2615] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:42.726701 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.736689 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28e13-b2c8-465d-9012-3ff2d4b1c8ed admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.741547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.742263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.742589 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.742877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] PATH_INFO: `/v3/projects/6b63f403bbef4558891ced9230dbb448/users/6ccf852628f24211b63c06e40dbf369b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.744870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b63f403bbef4558891ced9230dbb448, user_id=6ccf852628f24211b63c06e40dbf369b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.747550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8adae5-ae1b-467b-9a24-b1b03024b174 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.757514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be14a0-b7cc-48b1-90b7-9906af2c94fb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:42.759296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1299/2616] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:42 2022] PUT /identity/v3/projects/6b63f403bbef4558891ced9230dbb448/users/6ccf852628f24211b63c06e40dbf369b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:42.772168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.772457 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.772750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.800029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] MFA Rules not processed for user `6ccf852628f24211b63c06e40dbf369b`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:42.801271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.817024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:42.817796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.818079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.818382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] PATH_INFO: `/v3/projects/2d674d51d4114af29d5b3999e59836a1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.819603 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d674d51d4114af29d5b3999e59836a1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:42.821504 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:42.838300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:42.849778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:42.884574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1300/2617] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:42.885238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d674d51d4114af29d5b3999e59836a1', 'request_id': 'req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.897128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d674d51d4114af29d5b3999e59836a1', 'request_id': 'req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.897679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:42.899197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.905442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d674d51d4114af29d5b3999e59836a1', 'request_id': 'req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.919396 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] The token cache is being invalidate because project 2d674d51d4114af29d5b3999e59836a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:42.919817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.920493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4fbb57d-5a39-4cb5-afca-5cf8610495e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:42.922182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1318/2618] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:42 2022] DELETE /identity/v3/projects/2d674d51d4114af29d5b3999e59836a1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:42.927011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020768-ceb2-49d5-a351-c3c6f95fcf8d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:42.927891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020768-ceb2-49d5-a351-c3c6f95fcf8d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:42.927891 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12020768-ceb2-49d5-a351-c3c6f95fcf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:42.949024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-12020768-ceb2-49d5-a351-c3c6f95fcf8d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:42.950275 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-12020768-ceb2-49d5-a351-c3c6f95fcf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:42.965471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece639-9242-46be-b846-3a0e9edc732a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.015514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1319/2619] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:43.023974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.024261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.024541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.027308 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.027938 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.028230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.028513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.030570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:43.044711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:43.045948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:43.054220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1320/2620] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:43.058348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.067896 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1983b-3f4e-40ae-8dc8-d870cda23602 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.073127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.073798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.074082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.074358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.075093 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:43.075399 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.076998 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.095329 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1321/2621] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:18:43.097004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.099172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.100654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.106838 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044a7bf-0f1e-46fc-aafd-42167acaa64e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.111152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1301/2622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:43.112074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.112702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.112992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.113305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.113983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.116376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.149058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1322/2623] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:43.150171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.161999 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97ac4-ecf1-4b36-b389-12b91403e1b2 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.189044 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.190819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:43.201500 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:43.228152 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.228782 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.229066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.229351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.230025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.231989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.255210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35282d5-a7d5-42f6-b57f-8e46ff306ec1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.255550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1302/2624] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:43.258979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.259550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.259721 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.259918 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.260195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.261943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:43.270602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1eb8d-ec8c-4f42-a1ef-58ba295a1c26 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.275925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.276812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.277213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.277556 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.278419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.280463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.294126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1303/2625] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:43.295831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:43.298858 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.309586 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b78807-f229-4590-8336-5a4c5207c7c7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.314399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.315071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.315363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.315643 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.316911 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.318572 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.329941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1304/2626] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:43.334470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.335316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.337079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d91c0-1833-495d-ac11-0db245cb9296 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.344720 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3152-f220-4187-aac6-8970826d199b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.346872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1323/2627] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:43.349960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.350672 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.350961 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.351244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] PATH_INFO: `/v3/projects/91e74bbc75a0408cbd9f607515258b14/users/901c4c6282264093a27e27a30174edf0/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.368599 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e74bbc75a0408cbd9f607515258b14, user_id=901c4c6282264093a27e27a30174edf0, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.371331 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.390600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1305/2628] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:43 2022] PUT /identity/v3/projects/91e74bbc75a0408cbd9f607515258b14/users/901c4c6282264093a27e27a30174edf0/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:43.401514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.401842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.402131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.434727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] MFA Rules not processed for user `901c4c6282264093a27e27a30174edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:43.435995 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:43.542567 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1324/2629] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:43.549129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.631166 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837645-945e-4c03-85d1-6dc4e1826405 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.636174 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.636814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.637102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.637383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.638087 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.640288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.679046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1306/2630] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:43.683258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.694978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e96da-5571-44b1-a16f-5c0d7eece7d2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.756771 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.757403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.757688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.758242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.758648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.760585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.785522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1325/2631] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:43 2022] POST /identity/v3/users => generated 306 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:43.789736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.801187 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807c41-f1f6-4fce-b61e-a8136aef14ab admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.807066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.807826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.808241 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.808562 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.809318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.811098 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.822516 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1307/2632] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:43.827277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.841011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4009d-e8e2-447a-a4cc-e027f0d5eb41 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.846234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.847014 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.847303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.848187 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] PATH_INFO: `/v3/projects/93d97e4438764d5f9b10994408325b5d/users/0f9c62b6f0d74abb81e41a126836ba94/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.863816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d97e4438764d5f9b10994408325b5d, user_id=0f9c62b6f0d74abb81e41a126836ba94, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.866834 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.881908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1326/2633] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:43 2022] PUT /identity/v3/projects/93d97e4438764d5f9b10994408325b5d/users/0f9c62b6f0d74abb81e41a126836ba94/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:43.885795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:43.900161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe131a-bd93-45f0-9851-dae7031681c6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:43.955912 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:43.968943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:43.969578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:43.969875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:43.970158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:43.970893 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:43.973275 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09e930-58c9-4712-9162-7e9face591d0 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:43.985787 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1308/2634] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:43.991265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:44.002523 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ac3f-5b34-4e81-97ed-e40c1167b073 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:44.007713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:44.008381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:44.008664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:44.008943 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] PATH_INFO: `/v3/projects/93d97e4438764d5f9b10994408325b5d/users/0f9c62b6f0d74abb81e41a126836ba94/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:44.010980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d97e4438764d5f9b10994408325b5d, user_id=0f9c62b6f0d74abb81e41a126836ba94, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:44.013583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:44.026048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1327/2635] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:43 2022] PUT /identity/v3/projects/93d97e4438764d5f9b10994408325b5d/users/0f9c62b6f0d74abb81e41a126836ba94/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:44.037835 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:44.038161 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:44.038471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:44.067988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] MFA Rules not processed for user `0f9c62b6f0d74abb81e41a126836ba94`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:44.069182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:44.140985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1309/2636] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:44.152498 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:44.154232 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:44.164852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:44.213982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a723f-2992-4b5f-89e0-bd0ce8b39df6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:44.217649 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:44.218267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:44.218597 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:44.218877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:44.229344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:44.230812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:44.240168 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1328/2637] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:44.318022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:44.327823 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3d11-67c8-429a-9614-9f63fc45f598 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:44.331507 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:44.334654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:44.334954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:44.335239 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:44.393696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:44.395888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:44.405177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1310/2638] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:46.378186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:46.379924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:46.447685 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989e327-283c-4bce-bfd8-89c539ef6d79 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:46.452178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:46.452830 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:46.453110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:46.453386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] PATH_INFO: `/v3/users/ff53a8c657c54451bef48439a70d59e5` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:46.454590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff53a8c657c54451bef48439a70d59e5)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:46.456488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:46.510417 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff53a8c657c54451bef48439a70d59e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.511115 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff53a8c657c54451bef48439a70d59e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.523877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff53a8c657c54451bef48439a70d59e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.530679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff53a8c657c54451bef48439a70d59e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.531346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff53a8c657c54451bef48439a70d59e5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.546634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1329/2639] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:46 2022] DELETE /identity/v3/users/ff53a8c657c54451bef48439a70d59e5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:46.729492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:46.740555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a07c97-8fc8-46fb-afbd-71047f64d230 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:46.802743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:46.803385 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:46.803674 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:46.803957 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] PATH_INFO: `/v3/projects/9cd64eeb2b1046cd9e41c90494f9aa7a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:46.805120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd64eeb2b1046cd9e41c90494f9aa7a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:46.807084 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:46.825634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:46.855918 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd64eeb2b1046cd9e41c90494f9aa7a', 'request_id': 'req-96186b61-614f-4aea-a903-faa0e00270d6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.863080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd64eeb2b1046cd9e41c90494f9aa7a', 'request_id': 'req-96186b61-614f-4aea-a903-faa0e00270d6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.868678 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd64eeb2b1046cd9e41c90494f9aa7a', 'request_id': 'req-96186b61-614f-4aea-a903-faa0e00270d6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.880336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] The token cache is being invalidate because project 9cd64eeb2b1046cd9e41c90494f9aa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:46.880544 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.881168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:46.882744 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1311/2640] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:46 2022] DELETE /identity/v3/projects/9cd64eeb2b1046cd9e41c90494f9aa7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:46.887137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:46.888660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:46.903710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e1a50-96f6-49a1-a2e2-74eab914d6a8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:46.929467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:46.962040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:46.962726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:46.963015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:46.963294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] PATH_INFO: `/v3/users/2ad2f557856b4dda80951650bb7e1605` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:46.964478 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad2f557856b4dda80951650bb7e1605)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:46.966382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.011489 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad2f557856b4dda80951650bb7e1605'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.012153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad2f557856b4dda80951650bb7e1605'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.024773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad2f557856b4dda80951650bb7e1605'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.031611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad2f557856b4dda80951650bb7e1605'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.032280 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-03ee672d-867c-4df5-82dd-13b91abfb040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad2f557856b4dda80951650bb7e1605'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.044825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1330/2641] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:46 2022] DELETE /identity/v3/users/2ad2f557856b4dda80951650bb7e1605 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:47.224068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.226262 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:47.340845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186b61-614f-4aea-a903-faa0e00270d6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.425946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.426632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.426916 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.427193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] PATH_INFO: `/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.428369 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3950e2cf2df4cbf94a60ada0beb1134)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.430255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.496931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:47.502594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3950e2cf2df4cbf94a60ada0beb1134', 'request_id': 'req-40173341-e800-4b05-a58a-a84082c0e415'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.522100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3950e2cf2df4cbf94a60ada0beb1134', 'request_id': 'req-40173341-e800-4b05-a58a-a84082c0e415'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.528793 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3950e2cf2df4cbf94a60ada0beb1134', 'request_id': 'req-40173341-e800-4b05-a58a-a84082c0e415'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.540359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] The token cache is being invalidate because project d3950e2cf2df4cbf94a60ada0beb1134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:47.540656 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.541326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-40173341-e800-4b05-a58a-a84082c0e415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:47.542865 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1312/2642] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:47 2022] DELETE /identity/v3/projects/d3950e2cf2df4cbf94a60ada0beb1134 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:47.548591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.549080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.549186 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.616706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:47.624370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:47.694249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1331/2643] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:47.702151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.702478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.702754 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.723741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:47.724973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:47.739472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1313/2644] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:47.744012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.754675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f92f4-5161-4b9f-8902-385a918bad2b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.759332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.759991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.760229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.760507 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.761206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:47.761513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.763132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.777758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1332/2645] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:47.782128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.793099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f0155-c4ac-44df-9555-1d80d839e739 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.799019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.799644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.799921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.800193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.801371 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.803285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.831988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1314/2646] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:47.838031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.842866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:47.847200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969490f6-6be9-4cff-99ce-1e7eeb393d03 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.909680 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.910898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.911183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.911462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.912122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.914164 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.936657 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1333/2647] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:47 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:47.940852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.952873 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36d0-ece1-4cde-9f74-e8809d6c3370 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.959319 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.960060 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.960458 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.960838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.961682 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.963530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:47.974798 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1315/2648] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:47.978856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:47.989097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd5808-e75b-4de4-a50f-cb2b3f3b0f25 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:47.995662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:47.996294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:47.996582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:47.996890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:47.999179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:47.999321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e135c-12e5-458e-9764-f4c2a1d0979c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:48.012881 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1334/2649] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:48.017251 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:48.029728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d37df-0062-464f-b5f5-9ac3d3cae192 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:48.034791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:48.036142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:48.036438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:48.036724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] PATH_INFO: `/v3/projects/03d8d9dfffe04687aba27d5115167b96/users/77d216eb3bd04e0b9c3ebe5150e4586b/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:48.053831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d8d9dfffe04687aba27d5115167b96, user_id=77d216eb3bd04e0b9c3ebe5150e4586b, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:48.057213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:48.070647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1316/2650] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:48 2022] PUT /identity/v3/projects/03d8d9dfffe04687aba27d5115167b96/users/77d216eb3bd04e0b9c3ebe5150e4586b/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:48.081066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:48.081379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:48.082473 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:48.112849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] MFA Rules not processed for user `77d216eb3bd04e0b9c3ebe5150e4586b`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:48.114271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:48.181231 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1335/2651] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:48.193628 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:48.195316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:48.267214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090dce7-ba41-4765-abbf-6155c772f2b1 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:48.271763 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:48.272380 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:48.272669 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:48.272951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:48.281579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:48.283081 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9217-ab8b-4155-a67a-63c8cdc86938 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:48.292574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1317/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:48.721611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:48.722979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:48.792079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16884a-e08a-4b0e-a052-f0a7ece9629e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:48.796591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:48.797261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:48.797549 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:48.797996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] PATH_INFO: `/v3/users/901c4c6282264093a27e27a30174edf0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:48.799288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] RBAC: Authorizing `identity:delete_user(user_id=901c4c6282264093a27e27a30174edf0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:48.801774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:48.819381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:48.855702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901c4c6282264093a27e27a30174edf0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:48.856388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901c4c6282264093a27e27a30174edf0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:48.869290 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901c4c6282264093a27e27a30174edf0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:48.876343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901c4c6282264093a27e27a30174edf0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:48.877080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901c4c6282264093a27e27a30174edf0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:48.892430 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1336/2653] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:48 2022] DELETE /identity/v3/users/901c4c6282264093a27e27a30174edf0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:48.897355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:48.897921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:48.897921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:48.917978 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:48.919315 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:48.975832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:48.989131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1318/2654] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:48.998820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:49.000307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:49.071981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fdb2-6d97-4306-8ddc-dc582737268a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:49.078057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:49.078735 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:49.079021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:49.079298 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:49.089662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:49.091221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:49.102073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1337/2655] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:49.418982 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:49.420756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:49.435023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df7ecf-f547-4a26-b2e4-10d4e91c3091 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:49.440054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:49.440722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:49.441110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:49.441448 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] PATH_INFO: `/v3/projects/91e74bbc75a0408cbd9f607515258b14` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:49.442715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e74bbc75a0408cbd9f607515258b14)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:49.444776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:49.496984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e74bbc75a0408cbd9f607515258b14', 'request_id': 'req-cb60191e-9a35-4de5-a3f2-59a357d57442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.506269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e74bbc75a0408cbd9f607515258b14', 'request_id': 'req-cb60191e-9a35-4de5-a3f2-59a357d57442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.513693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e74bbc75a0408cbd9f607515258b14', 'request_id': 'req-cb60191e-9a35-4de5-a3f2-59a357d57442'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.526566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] The token cache is being invalidate because project 91e74bbc75a0408cbd9f607515258b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:49.526864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.527543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.529083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1319/2656] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:49 2022] DELETE /identity/v3/projects/91e74bbc75a0408cbd9f607515258b14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:49.533146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:49.543541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2108-9fe1-41d2-8b06-66818f943a54 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:49.601047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:49.601589 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:49.601869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:49.602150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] PATH_INFO: `/v3/users/0f9c62b6f0d74abb81e41a126836ba94` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:49.603370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9c62b6f0d74abb81e41a126836ba94)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:49.605288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:49.649939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:49.661725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9c62b6f0d74abb81e41a126836ba94'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.662557 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9c62b6f0d74abb81e41a126836ba94'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.678073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9c62b6f0d74abb81e41a126836ba94'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.687104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9c62b6f0d74abb81e41a126836ba94'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.687867 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6cae1f3f-2163-4fde-a199-d4c1cbb4cc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9c62b6f0d74abb81e41a126836ba94'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:49.704274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1338/2657] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:49 2022] DELETE /identity/v3/users/0f9c62b6f0d74abb81e41a126836ba94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:50.017043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.018646 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:50.033480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60191e-9a35-4de5-a3f2-59a357d57442 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.100092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.100851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.101204 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.101641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] PATH_INFO: `/v3/projects/93d97e4438764d5f9b10994408325b5d` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.102907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d97e4438764d5f9b10994408325b5d)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.112089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.164359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d97e4438764d5f9b10994408325b5d', 'request_id': 'req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:50.172027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d97e4438764d5f9b10994408325b5d', 'request_id': 'req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:50.178193 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d97e4438764d5f9b10994408325b5d', 'request_id': 'req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:50.190157 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] The token cache is being invalidate because project 93d97e4438764d5f9b10994408325b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:50.190468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:50.191238 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51cace5d-efdb-4ba9-b2aa-d9658e6d0641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:50.192839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1320/2658] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:50 2022] DELETE /identity/v3/projects/93d97e4438764d5f9b10994408325b5d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:50.197820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.198326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.198591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.220810 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:50.221956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:50.282471 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1339/2659] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:50.290921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.291083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.291340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.311677 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:50.312915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:50.327870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1321/2660] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:50.329083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.339959 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95058f-2a35-42d4-89b6-5f0d34516b26 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.348374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.349098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.350281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.350281 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.350593 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:50.351128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.352684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.365727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1340/2661] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:18:50.370151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.376018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:50.379540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9410903-703d-4a9b-a236-2937fe393cd4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.395578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.396668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.397176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.397679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.399127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.402276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.436837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1322/2662] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:50.438853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.449436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c170f8d-f646-4e1a-abce-c500321c1190 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.535027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.535728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.536108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.536481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.538682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.541427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.567328 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1341/2663] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:50.571469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.583255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922d5f0-1ccd-4c16-85c1-a030996ec85d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.588296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.588928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.589207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.589481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.590171 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.591908 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.602580 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1323/2664] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:50.606820 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.616835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d31ac-ee12-44a3-b3b8-1b03a7af1ffa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.622828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.623470 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.623776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.624056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.624748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.626323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4312882-7209-4f4d-800a-f7512c4a2ac9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.637644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1342/2665] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:50.642361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.655181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d149a-e832-4946-8c72-4723d7d09ffc admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.660122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.660792 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.661080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.661359 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] PATH_INFO: `/v3/projects/e3dbcbcba19f4141bcbd7cfedbea6e2d/users/1f9902a48c3d4968ac67687fd3595ec5/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.677714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dbcbcba19f4141bcbd7cfedbea6e2d, user_id=1f9902a48c3d4968ac67687fd3595ec5, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.680478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.693860 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1324/2666] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:50 2022] PUT /identity/v3/projects/e3dbcbcba19f4141bcbd7cfedbea6e2d/users/1f9902a48c3d4968ac67687fd3595ec5/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:50.704301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.704591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.704886 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.732541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] MFA Rules not processed for user `1f9902a48c3d4968ac67687fd3595ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:50.733761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:50.741956 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:50.806184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1343/2667] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:50.810773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.873181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a539ee-5611-41b2-8667-44567379b218 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.880030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.880659 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.880942 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.881220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.881900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.883845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:50.915993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1325/2668] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:50.917229 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:50.928460 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095252f-02e8-4bd7-a77c-0f3867da8cd6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:50.983833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:50.984451 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:50.984736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:50.985018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:50.985667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:50.987610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.010073 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1344/2669] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:50 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:51.015172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.029153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bafe-4874-4f3c-8ecf-92a179439324 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.033836 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.034471 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.034804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.035086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.035779 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.037469 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.048255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1326/2670] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:51.053563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.063777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12332dab-167d-438a-8ab4-c7a2776d5f44 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.069358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.070037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.070326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.070650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] PATH_INFO: `/v3/projects/93af927a75e54a539368c8189a690ae7/users/6c8e1a76bcbc4525ae7836eb0496ca4f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.085966 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93af927a75e54a539368c8189a690ae7, user_id=6c8e1a76bcbc4525ae7836eb0496ca4f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.088667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.102019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1345/2671] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:51 2022] PUT /identity/v3/projects/93af927a75e54a539368c8189a690ae7/users/6c8e1a76bcbc4525ae7836eb0496ca4f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:51.106136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.117124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0849c-0266-4507-b2c0-a43e2a8a3856 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.171765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.172293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.172610 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.172885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.173565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.175198 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5aca-852d-4a03-8a9f-797922ad23c4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.185574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1327/2672] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:51.189774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.200817 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe675ba-663b-4363-b165-149fd5fc8ec5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.205491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.206152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.206469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.206846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] PATH_INFO: `/v3/projects/93af927a75e54a539368c8189a690ae7/users/6c8e1a76bcbc4525ae7836eb0496ca4f/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.208855 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93af927a75e54a539368c8189a690ae7, user_id=6c8e1a76bcbc4525ae7836eb0496ca4f, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.211547 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.221566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1346/2673] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:51 2022] PUT /identity/v3/projects/93af927a75e54a539368c8189a690ae7/users/6c8e1a76bcbc4525ae7836eb0496ca4f/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:51.233227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.233524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.233806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.262520 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] MFA Rules not processed for user `6c8e1a76bcbc4525ae7836eb0496ca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:51.263717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:51.268624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:51.334670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1328/2674] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:51.345314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.347078 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:51.407224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79448-530d-451d-8c59-98c961f9c824 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.411450 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.412068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.412352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.412631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.421573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.423142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.433062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1347/2675] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:51.533932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:51.544524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb20d7a-7b78-4e39-b8e8-488097c3d7a0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:51.548256 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:51.548870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:51.549156 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:51.549433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:51.608554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:51.610006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8278-f16d-4e66-90b9-654c1bda702b service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:51.620351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1329/2676] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:54.424493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:54.430510 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:54.487936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9a29-49d7-4fe4-8088-e5bd3cac18d0 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:54.493110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:54.493756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:54.494046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:54.494358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] PATH_INFO: `/v3/users/1f9902a48c3d4968ac67687fd3595ec5` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:54.495571 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9902a48c3d4968ac67687fd3595ec5)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:54.497482 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:54.546697 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9902a48c3d4968ac67687fd3595ec5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:54.547381 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9902a48c3d4968ac67687fd3595ec5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:54.560263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9902a48c3d4968ac67687fd3595ec5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:54.567594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9902a48c3d4968ac67687fd3595ec5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:54.568323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9902a48c3d4968ac67687fd3595ec5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:54.581514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1348/2677] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:54 2022] DELETE /identity/v3/users/1f9902a48c3d4968ac67687fd3595ec5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:54.586694 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:54.587201 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:54.587299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:54.607138 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:54.608384 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:54.676227 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1330/2678] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:54.686464 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:54.688029 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:54.720131 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:54.722111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:54.747625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84082adc-2fd8-4b18-ac7c-079c97a56602 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:54.751269 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:54.751890 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:54.752175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:54.752457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:54.762015 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:54.763564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:54.768225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:54.774035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1349/2679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:54.781165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7a6b-4920-49f1-817f-d720c8d99816 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:54.784994 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:54.785614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:54.785898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:54.786936 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:54.788783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:54.865303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:54.867414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:54.878880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1331/2680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:55.118255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:55.121819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:55.140718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40f909-b443-4b52-a206-93dfa2683467 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:55.147323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:55.148170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:55.148574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:55.148798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] PATH_INFO: `/v3/projects/e3dbcbcba19f4141bcbd7cfedbea6e2d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:55.150041 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dbcbcba19f4141bcbd7cfedbea6e2d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:55.151974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:55.180594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:55.211704 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dbcbcba19f4141bcbd7cfedbea6e2d', 'request_id': 'req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.217286 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dbcbcba19f4141bcbd7cfedbea6e2d', 'request_id': 'req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.224660 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dbcbcba19f4141bcbd7cfedbea6e2d', 'request_id': 'req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.238698 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] The token cache is being invalidate because project e3dbcbcba19f4141bcbd7cfedbea6e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:55.239016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.239722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.241224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1350/2681] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:55 2022] DELETE /identity/v3/projects/e3dbcbcba19f4141bcbd7cfedbea6e2d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:55.245542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:55.262143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294deee-a737-4346-9bac-3f0a945f8112 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:55.341276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:55.341915 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:55.342206 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:55.342528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] PATH_INFO: `/v3/users/6c8e1a76bcbc4525ae7836eb0496ca4f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:55.343759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8e1a76bcbc4525ae7836eb0496ca4f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:55.345663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:55.398254 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8e1a76bcbc4525ae7836eb0496ca4f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.406530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8e1a76bcbc4525ae7836eb0496ca4f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.424136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8e1a76bcbc4525ae7836eb0496ca4f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.431621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8e1a76bcbc4525ae7836eb0496ca4f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.432225 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-14e68029-f0e5-4a36-8cca-4b05b3d12a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8e1a76bcbc4525ae7836eb0496ca4f'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.438466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1332/2682] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:55 2022] DELETE /identity/v3/users/6c8e1a76bcbc4525ae7836eb0496ca4f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:55.729346 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:55.731514 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:55.750682 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2a5c-6299-4ba5-85d4-9bc8d848cca9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:55.814505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:55.815057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:55.815357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:55.815623 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] PATH_INFO: `/v3/projects/93af927a75e54a539368c8189a690ae7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:55.816787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=93af927a75e54a539368c8189a690ae7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:55.818756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:55.867191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93af927a75e54a539368c8189a690ae7', 'request_id': 'req-c006824a-6446-4995-89fa-dea6291ad5ea'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.872611 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93af927a75e54a539368c8189a690ae7', 'request_id': 'req-c006824a-6446-4995-89fa-dea6291ad5ea'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.888008 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93af927a75e54a539368c8189a690ae7', 'request_id': 'req-c006824a-6446-4995-89fa-dea6291ad5ea'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.904669 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] The token cache is being invalidate because project 93af927a75e54a539368c8189a690ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:55.904958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.905634 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c006824a-6446-4995-89fa-dea6291ad5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:55.907200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1351/2683] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:55 2022] DELETE /identity/v3/projects/93af927a75e54a539368c8189a690ae7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:55.912989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:55.913718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:55.913718 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:55.934526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:55.935728 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:55.945767 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:56.016495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1333/2684] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:56.024852 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.025205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.025476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.025759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.026565 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.039336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10682-014d-4834-909b-cae33701e7c0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.044027 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.044668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.044962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.045249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] PATH_INFO: `/v3/users/77d216eb3bd04e0b9c3ebe5150e4586b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.046135 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:56.046420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d216eb3bd04e0b9c3ebe5150e4586b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.047377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.048361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.055371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1352/2685] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:56.059530 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.068792 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed690b-c65f-42f9-9f75-f0f10e2d0725 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.074105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.075249 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.076035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.076355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.077007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:56.077402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.079056 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.092646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1353/2686] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:18:56.096527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.106118 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d216eb3bd04e0b9c3ebe5150e4586b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.107306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361eb4e-cc30-4f32-92b0-a191109abba5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.112193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.112808 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.113085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d216eb3bd04e0b9c3ebe5150e4586b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.113204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.113358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.114031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.115970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.131222 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d216eb3bd04e0b9c3ebe5150e4586b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.141609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d216eb3bd04e0b9c3ebe5150e4586b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.142061 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:56.142566 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-af94d14d-685f-439b-91b0-cab6cb00ea34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d216eb3bd04e0b9c3ebe5150e4586b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.151294 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1334/2687] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:56 2022] DELETE /identity/v3/users/77d216eb3bd04e0b9c3ebe5150e4586b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:56.152503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1354/2688] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:56.155890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.156216 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.156485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.156633 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.158213 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.175814 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:56.177044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.225786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e829-43af-418a-8eab-57422ab61477 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.230928 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.231553 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.231841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.232123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.232798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.234752 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.238024 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1335/2689] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:56.249824 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.251484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.257273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1355/2690] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:56.261895 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.272749 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0a3da-a29c-4d4a-a755-d671be06a7cd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.277763 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.278383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.278729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.279004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.279707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.281300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.289545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:56.292715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1356/2691] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:56.296777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.307857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099055b-5e05-42a7-92bb-1b90911180b5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.313282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.313904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.314195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.314508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.315199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.316851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.328163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621404c7-65ea-47c4-9805-dfe0ae775077 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.328621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1357/2692] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:56.333561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.335819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.336456 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.336748 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.337029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.343546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4347444-f56c-4e35-9416-0097e40823f1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.346732 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.348194 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4726f-726c-4664-8a23-3fd42e3aa422 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.349110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.349794 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.350081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.350397 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] PATH_INFO: `/v3/projects/cd02689a400445c39618b8735615d35e/users/32363d88f7784b6e8c168ec47df05c44/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.359964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1336/2693] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:56.369435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd02689a400445c39618b8735615d35e, user_id=32363d88f7784b6e8c168ec47df05c44, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.372218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.391198 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1358/2694] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:56 2022] PUT /identity/v3/projects/cd02689a400445c39618b8735615d35e/users/32363d88f7784b6e8c168ec47df05c44/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:56.403436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.403735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.404025 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.435535 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] MFA Rules not processed for user `32363d88f7784b6e8c168ec47df05c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:56.437409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.515288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1337/2695] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:56.520030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.586238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd82d8-cb06-4eaf-80f9-b3366fe487af admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.590951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.591577 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.591849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.592122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.592783 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.594707 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.622992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1359/2696] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:18:56.626921 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.638812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ccb92-9e6c-4f9c-9195-28f94b29fd75 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.649053 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.650862 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.687911 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:56.706919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.707700 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.708545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.708831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.709511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.711485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.723380 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac8cf-4974-4f48-9222-1ba13653e4a0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.728338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.729016 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.729301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.729619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] PATH_INFO: `/v3/projects/03d8d9dfffe04687aba27d5115167b96` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.730878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d8d9dfffe04687aba27d5115167b96)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.732818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.733644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1338/2697] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:56.738051 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.748099 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bdc6-9cd7-4c27-88c8-59ce6ccd489b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.752927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.753532 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.753821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.754104 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.755403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.757041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.771039 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1339/2698] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:56.772407 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.784613 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98a91-dccb-4121-87e0-374eb4c52dfd admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.786370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d8d9dfffe04687aba27d5115167b96', 'request_id': 'req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.792905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d8d9dfffe04687aba27d5115167b96', 'request_id': 'req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.799419 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d8d9dfffe04687aba27d5115167b96', 'request_id': 'req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.814835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] The token cache is being invalidate because project 03d8d9dfffe04687aba27d5115167b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:56.815175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.815846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d03399a1-3dce-48c2-a0a0-ad87dd9badd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:56.818047 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1360/2699] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:56 2022] DELETE /identity/v3/projects/03d8d9dfffe04687aba27d5115167b96 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:56.825675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64215-13c8-4271-a1f0-0a7d3396d27d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.825990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64215-13c8-4271-a1f0-0a7d3396d27d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.826629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64215-13c8-4271-a1f0-0a7d3396d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.836205 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:56.850923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-54b64215-13c8-4271-a1f0-0a7d3396d27d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:56.852125 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-54b64215-13c8-4271-a1f0-0a7d3396d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.858202 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.858922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.859210 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.859533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] PATH_INFO: `/v3/projects/10698f72658f413c8c67c0c6c22071c7/users/ae6c0fb7da334147acd6ec7aaafd7532/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.875552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10698f72658f413c8c67c0c6c22071c7, user_id=ae6c0fb7da334147acd6ec7aaafd7532, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.878223 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.891838 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1340/2700] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:56 2022] PUT /identity/v3/projects/10698f72658f413c8c67c0c6c22071c7/users/ae6c0fb7da334147acd6ec7aaafd7532/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:56.896002 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:56.897765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:56.914423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1361/2701] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:56.968922 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb894-762a-4704-b294-5d2e90c11631 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:56.974263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:56.974990 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.975280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.975561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.976272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:56.977898 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:56.981673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:56.981992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:56.982307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:56.992180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1341/2702] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:18:56.993433 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.003019 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4d05a-2232-4917-a2a9-ee7cde1bc1f3 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.003495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:57.005326 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.009075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.009761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.010032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.010351 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] PATH_INFO: `/v3/projects/10698f72658f413c8c67c0c6c22071c7/users/ae6c0fb7da334147acd6ec7aaafd7532/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.012313 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10698f72658f413c8c67c0c6c22071c7, user_id=ae6c0fb7da334147acd6ec7aaafd7532, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.014980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec8526-a54f-49fe-84c6-644aa939fa7a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.018161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1362/2703] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:57.019325 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.027176 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1342/2704] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:56 2022] PUT /identity/v3/projects/10698f72658f413c8c67c0c6c22071c7/users/ae6c0fb7da334147acd6ec7aaafd7532/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:57.038119 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53a90-94fe-411f-b7ba-50794969295d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.095329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.095693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.095890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.105708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:57.132197 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.133181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.133847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] MFA Rules not processed for user `ae6c0fb7da334147acd6ec7aaafd7532`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:57.134204 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.134756 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.135610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:18:57.135839 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.136256 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.138103 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.153105 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1363/2705] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:18:57.159037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.173018 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6a5b-88f5-424a-a48f-0d7ca5bb33c0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.180461 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.180968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.181258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.181536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.182221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.184701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.218778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1364/2706] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:18:57 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:57.223273 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.256797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1343/2707] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:57.268478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.270318 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.296631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3a0e-c394-4535-8e80-099f615f8741 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.303160 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.304775 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.305128 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.305477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.306239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.307891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:57.308403 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.334513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1365/2708] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:18:57 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:18:57.339409 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.351843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d90e-3545-466e-b5fd-c546f5c92fc8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.356787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.357350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.357585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233b216-d8b9-4a66-b101-7358319e26be None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.357700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.357905 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.358648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.360402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.375809 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1366/2709] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:57.376869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.390971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb122-a875-453c-99a3-d18d8aab3b26 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.397323 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.398058 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.398435 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.398859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.399666 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.401684 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.416940 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1367/2710] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:18:57.418729 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.419445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.419731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.420059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.422469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.433002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa7ad-4976-4e2a-8fb0-8916cff8d82e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.438264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.438964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.439307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.439529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] PATH_INFO: `/v3/projects/4f66f2b6e3af45ea885f558096581390/users/9c029ba3eb7546218ec499f9132723e8/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.455195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f66f2b6e3af45ea885f558096581390, user_id=9c029ba3eb7546218ec499f9132723e8, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.459024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05215fdc-5d7a-4e8a-8650-039d156e3b5e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.485655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1368/2711] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:18:57 2022] PUT /identity/v3/projects/4f66f2b6e3af45ea885f558096581390/users/9c029ba3eb7546218ec499f9132723e8/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:57.496513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.496909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.497246 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.503966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.505807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.519679 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1344/2712] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:57.532179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] MFA Rules not processed for user `9c029ba3eb7546218ec499f9132723e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:57.533421 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.602718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:57.613453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1369/2713] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:57.625888 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.636041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774212-1726-4bbb-852e-bbb6309a5c8b service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.690129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.690785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.691070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.691348 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.695137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.696615 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.701810 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.703424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.709598 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f39c6-739e-4c94-8388-6d4b49c73b34 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.713173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.713314 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1345/2714] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:57.713859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.714145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.714509 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.716267 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.740207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:57.779635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.781490 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085deace-cbd6-42cc-af7c-d217601d14ad service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.783925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:57.792321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1370/2715] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:57.808124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b5378-6c32-439c-b885-8df21ed52c18 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:57.812750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:57.813399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.813687 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.813968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] PATH_INFO: `/v3/users/9c029ba3eb7546218ec499f9132723e8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.815168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c029ba3eb7546218ec499f9132723e8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:57.817136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:57.869128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c029ba3eb7546218ec499f9132723e8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:57.876358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c029ba3eb7546218ec499f9132723e8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:57.888627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c029ba3eb7546218ec499f9132723e8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:57.897534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c029ba3eb7546218ec499f9132723e8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:57.898199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c029ba3eb7546218ec499f9132723e8'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:57.904558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1346/2716] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:57 2022] DELETE /identity/v3/users/9c029ba3eb7546218ec499f9132723e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:18:57.909132 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:57.909495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:57.909812 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:57.929469 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:57.930714 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:57.998422 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1371/2717] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:18:58.009424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:58.011316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:58.088775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f7ee-140c-4ed8-a5d0-a814545c34bf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:58.094717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:58.095547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:58.095937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:58.096347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:58.114891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:58.116808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:58.131195 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1347/2718] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:58.457335 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:58.459617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:58.474902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2585c-8251-471c-a820-72f543765c97 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:58.490644 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:58.491321 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:58.491664 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:58.491872 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] PATH_INFO: `/v3/projects/4f66f2b6e3af45ea885f558096581390` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:58.493357 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f66f2b6e3af45ea885f558096581390)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:58.495224 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:58.549426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f66f2b6e3af45ea885f558096581390', 'request_id': 'req-b627a77c-7769-4855-9d23-21ff0dc7ee39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:58.556343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f66f2b6e3af45ea885f558096581390', 'request_id': 'req-b627a77c-7769-4855-9d23-21ff0dc7ee39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:58.563076 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f66f2b6e3af45ea885f558096581390', 'request_id': 'req-b627a77c-7769-4855-9d23-21ff0dc7ee39'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:58.576564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] The token cache is being invalidate because project 4f66f2b6e3af45ea885f558096581390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:58.576865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:58.577693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b627a77c-7769-4855-9d23-21ff0dc7ee39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:58.579467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1372/2719] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:58 2022] DELETE /identity/v3/projects/4f66f2b6e3af45ea885f558096581390 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:58.902530 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:58.903890 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:58.916509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02daa7-9a89-46be-9751-c3225865fd9a service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:58.971446 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:58.972090 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:58.972373 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:58.972647 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] PATH_INFO: `/v3/users/b1c68705d7f84bfdbdb12d4bc8a525ba` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:58.973816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c68705d7f84bfdbdb12d4bc8a525ba)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:58.975747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:58.977989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:59.029217 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c68705d7f84bfdbdb12d4bc8a525ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.036261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c68705d7f84bfdbdb12d4bc8a525ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.047925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c68705d7f84bfdbdb12d4bc8a525ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.055170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c68705d7f84bfdbdb12d4bc8a525ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.055864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c68705d7f84bfdbdb12d4bc8a525ba'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.061937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1348/2720] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:58 2022] DELETE /identity/v3/users/b1c68705d7f84bfdbdb12d4bc8a525ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:59.066753 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:59.067786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:59.067978 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:59.087781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:18:59.089002 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.100796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:59.153869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1373/2721] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:18:59.164614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:59.174800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.230737 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31c9b-0a93-41f5-af1f-416fe0f3a114 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:59.234663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:59.235291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:59.235579 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:59.235892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:59.247080 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:59.248693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:59.260627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1349/2722] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:18:59.569693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:59.571153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.584856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae8ff8-99bb-44f0-b4e0-36fe3f2ddf09 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:59.589576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:59.590230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:59.590562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:59.590837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] PATH_INFO: `/v3/projects/ed6565447a824f6fb9fada688ffa3fae` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:59.592178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6565447a824f6fb9fada688ffa3fae)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:59.594184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:59.647069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6565447a824f6fb9fada688ffa3fae', 'request_id': 'req-db48c218-4b22-4f3a-a289-ddab7d2e7445'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.652805 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6565447a824f6fb9fada688ffa3fae', 'request_id': 'req-db48c218-4b22-4f3a-a289-ddab7d2e7445'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.653386 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:59.654928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.659004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6565447a824f6fb9fada688ffa3fae', 'request_id': 'req-db48c218-4b22-4f3a-a289-ddab7d2e7445'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.673974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] The token cache is being invalidate because project ed6565447a824f6fb9fada688ffa3fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:18:59.674485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.675118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.677912 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1374/2723] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:18:59 2022] DELETE /identity/v3/projects/ed6565447a824f6fb9fada688ffa3fae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:18:59.682063 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:18:59.683485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.755531 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b52e8-3f04-4ad8-8886-20989bdaf3e9 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:59.760148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:59.763700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48c218-4b22-4f3a-a289-ddab7d2e7445 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:18:59.769561 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:59.771159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:59.771442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:59.771719 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] PATH_INFO: `/v3/users/6ccf852628f24211b63c06e40dbf369b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:59.772910 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccf852628f24211b63c06e40dbf369b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:59.774864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:59.819574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:59.819954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:18:59.820587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:18:59.820933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:18:59.821224 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:18:59.822741 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccf852628f24211b63c06e40dbf369b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.823316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:18:59.823880 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccf852628f24211b63c06e40dbf369b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.836440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:18:59.838128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:18:59.838278 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccf852628f24211b63c06e40dbf369b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.845032 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccf852628f24211b63c06e40dbf369b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.845841 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2656bfe7-6650-4f51-9022-800aec0fe5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccf852628f24211b63c06e40dbf369b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:18:59.849543 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1350/2724] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:18:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:18:59.859513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1375/2725] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:18:59 2022] DELETE /identity/v3/users/6ccf852628f24211b63c06e40dbf369b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:19:00.151551 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.164693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1f3ae-f41a-4506-8f26-e2a80875a7bc service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.223962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.224508 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.224794 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.225094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] PATH_INFO: `/v3/projects/6b63f403bbef4558891ced9230dbb448` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.226240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b63f403bbef4558891ced9230dbb448)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.228478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.276428 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b63f403bbef4558891ced9230dbb448', 'request_id': 'req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:00.283861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b63f403bbef4558891ced9230dbb448', 'request_id': 'req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:00.289513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b63f403bbef4558891ced9230dbb448', 'request_id': 'req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:00.300542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] The token cache is being invalidate because project 6b63f403bbef4558891ced9230dbb448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:00.300833 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:00.301513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-323c3f01-6bb5-4e99-a2d5-a12df70c7afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:00.303066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1351/2726] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:00 2022] DELETE /identity/v3/projects/6b63f403bbef4558891ced9230dbb448 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:00.308072 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.308564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.308676 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.328339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:00.329548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:00.394355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1376/2727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:00.402892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.403219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.403506 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.422742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:00.423947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:00.432789 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1352/2728] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:00.436931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.447068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6aa8b-7a83-4d97-8701-fe18b7744b04 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.451550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.452153 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.452431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.452729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.453418 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:19:00.453740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.455372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.469610 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1377/2729] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:19:00.474130 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.483717 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfab34-1be8-4562-990d-ce53afe7588e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.488271 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.488931 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.489299 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.489776 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.491004 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.493663 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.516134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:00.525923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1353/2730] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:00 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:00.530122 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.540444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0e1c-b875-4ddb-9bed-b6c602f861f5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.602296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.602971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.603261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.603546 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.604222 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.606170 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.627486 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1378/2731] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:00 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:00.632334 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.643654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d4b6-b261-4b97-943a-f77fb3bbb688 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.649329 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.649960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.650250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.650576 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.651285 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.652909 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.663528 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1354/2732] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:00.667799 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.678262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987279-8391-49f3-9e81-39846eb374cb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.683023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.683645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.683925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.684206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.684996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.686645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad910155-7856-498f-988a-100fb70c78f0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.701619 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1379/2733] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:00.705759 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.717998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e87d-490a-46db-b46b-ab26761f03c7 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.723220 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.723895 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.724235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.724464 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] PATH_INFO: `/v3/projects/5b53a74f993e4cabafcd3256409f6cde/users/8099694506d7404c88fc173ea9b90ee7/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.739605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b53a74f993e4cabafcd3256409f6cde, user_id=8099694506d7404c88fc173ea9b90ee7, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.742411 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.756484 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1355/2734] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:00 2022] PUT /identity/v3/projects/5b53a74f993e4cabafcd3256409f6cde/users/8099694506d7404c88fc173ea9b90ee7/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:00.768365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314e29-532c-4c08-babd-59604f6b92c7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.768690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314e29-532c-4c08-babd-59604f6b92c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.769003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314e29-532c-4c08-babd-59604f6b92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.798206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-58314e29-532c-4c08-babd-59604f6b92c7 None None] MFA Rules not processed for user `8099694506d7404c88fc173ea9b90ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:00.799467 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-58314e29-532c-4c08-babd-59604f6b92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:00.812349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:00.865338 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1380/2735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:00.881594 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:00.884400 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:00.941230 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb4d1-279a-4023-a465-115a723041bb admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:00.944903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:00.945526 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:00.945816 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:00.946102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:00.955609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:00.957045 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:00.966059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1356/2736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:05.070087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bbd7-c47c-46ea-8ea5-5dcd2cce6fae None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:05.070700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bbd7-c47c-46ea-8ea5-5dcd2cce6fae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:05.070807 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bbd7-c47c-46ea-8ea5-5dcd2cce6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:05.090550 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-23c0bbd7-c47c-46ea-8ea5-5dcd2cce6fae None None] MFA Rules not processed for user `5cf524f6288040219c0492d3a794e830`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:05.091766 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-23c0bbd7-c47c-46ea-8ea5-5dcd2cce6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:05.148796 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1381/2737] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:10.962121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:12.509353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:12.511005 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:12.599891 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa348-14e8-41e3-927b-8ae44e495076 service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:12.605355 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:12.606006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:12.606296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:12.606617 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] PATH_INFO: `/v3/users/32363d88f7784b6e8c168ec47df05c44` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:12.607807 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32363d88f7784b6e8c168ec47df05c44)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:12.609781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:12.660231 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32363d88f7784b6e8c168ec47df05c44'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:12.670257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32363d88f7784b6e8c168ec47df05c44'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:12.683861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32363d88f7784b6e8c168ec47df05c44'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:12.691827 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32363d88f7784b6e8c168ec47df05c44'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:12.692587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32363d88f7784b6e8c168ec47df05c44'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:12.699709 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1357/2738] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:12 2022] DELETE /identity/v3/users/32363d88f7784b6e8c168ec47df05c44 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:12.704287 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:12.704798 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:12.704897 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:12.724453 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:12.725655 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:12.793194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1382/2739] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:12.805279 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:12.806815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:12.889192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b588a1-bc69-44b6-8e6c-d6965b30f7e0 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:12.892960 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:12.893590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:12.893880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:12.894164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:12.904415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:12.905853 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:12.915568 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1358/2740] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:13.177301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:13.178720 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:13.191465 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7720-c49a-429e-a63f-e83b6a473400 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:13.197201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:13.197864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:13.198150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:13.198427 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] PATH_INFO: `/v3/projects/cd02689a400445c39618b8735615d35e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:13.206143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd02689a400445c39618b8735615d35e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:13.208629 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:13.262527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd02689a400445c39618b8735615d35e', 'request_id': 'req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.267200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:13.268635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd02689a400445c39618b8735615d35e', 'request_id': 'req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.276230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd02689a400445c39618b8735615d35e', 'request_id': 'req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.290759 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] The token cache is being invalidate because project cd02689a400445c39618b8735615d35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:13.291118 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.291770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.293511 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1383/2741] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:13 2022] DELETE /identity/v3/projects/cd02689a400445c39618b8735615d35e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:13.297524 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:13.302352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:13.309796 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d19b-fd73-49b8-a6d6-2abc691426c5 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:13.375501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:13.376250 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:13.376491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:13.376877 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] PATH_INFO: `/v3/users/ae6c0fb7da334147acd6ec7aaafd7532` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:13.378036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6c0fb7da334147acd6ec7aaafd7532)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:13.379967 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:13.429797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6c0fb7da334147acd6ec7aaafd7532'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.436806 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6c0fb7da334147acd6ec7aaafd7532'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.449655 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6c0fb7da334147acd6ec7aaafd7532'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.458985 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6c0fb7da334147acd6ec7aaafd7532'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.460264 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-321f4fde-f68d-40b8-a8ce-870de4f7d347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6c0fb7da334147acd6ec7aaafd7532'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.467185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1359/2742] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:13 2022] DELETE /identity/v3/users/ae6c0fb7da334147acd6ec7aaafd7532 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:13.751062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:13.752529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:13.765922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6f98-24e9-4dbb-be56-f84c82fda1c5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:13.822104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:13.822797 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:13.823077 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:13.823351 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] PATH_INFO: `/v3/projects/10698f72658f413c8c67c0c6c22071c7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:13.824501 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10698f72658f413c8c67c0c6c22071c7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:13.826388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:13.875356 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10698f72658f413c8c67c0c6c22071c7', 'request_id': 'req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.880965 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10698f72658f413c8c67c0c6c22071c7', 'request_id': 'req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.887167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10698f72658f413c8c67c0c6c22071c7', 'request_id': 'req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.899659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] The token cache is being invalidate because project 10698f72658f413c8c67c0c6c22071c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:13.899952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.900582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4fe035d7-47bf-44ba-bcf0-dc3b70b8041c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:13.902313 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1384/2743] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:13 2022] DELETE /identity/v3/projects/10698f72658f413c8c67c0c6c22071c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:13.907055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:13.907541 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:13.907641 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:13.927976 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:13.929197 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:13.992143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1360/2744] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:13.999662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:13.999950 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.000230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.021052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:14.022262 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:14.031531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1385/2745] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:14.035724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.046043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b050ee5-2164-4e05-a09b-84ea20ef07ca None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.051006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.051715 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.052007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.052291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.052996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:19:14.053666 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.054941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.069221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1361/2746] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:19:14.071847 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.081254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073745-c3f8-4047-b9bc-dd18f3dc8553 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.086738 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.087282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.087563 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.087836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.088494 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.090420 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.117529 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1386/2747] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:14.121847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.131831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d5396-a49d-4741-b000-6e49573a80a6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.136408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:14.194459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.195128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.195414 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.195697 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.196441 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.198316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.219450 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1362/2748] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:14.223932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.235108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896ee4-38b1-4188-92d3-55e9bdad56e6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.240695 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.241333 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.241616 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.241893 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.242624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.244210 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.255778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1387/2749] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:14.260126 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.271097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2ea9c-3895-4e2a-b576-1b69bf808298 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.276402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.277018 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.277309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.277593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.278289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.279951 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773259cf-9c16-479e-be17-4af446165372 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.291504 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1363/2750] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:14.295785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.305630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad626ea-9d7f-4764-8777-986fc2db79dc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.310223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.310920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.311203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.311479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] PATH_INFO: `/v3/projects/7a5c8d79513c4b628b8eb5895ab31abf/users/8b42a419839f4c6da54e928ed67af20a/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.326067 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5c8d79513c4b628b8eb5895ab31abf, user_id=8b42a419839f4c6da54e928ed67af20a, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.328725 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.342825 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1388/2751] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:14 2022] PUT /identity/v3/projects/7a5c8d79513c4b628b8eb5895ab31abf/users/8b42a419839f4c6da54e928ed67af20a/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:14.354509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.354832 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.355111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.383346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] MFA Rules not processed for user `8b42a419839f4c6da54e928ed67af20a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:14.384548 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:14.455139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1364/2752] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:14.459777 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.473813 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:14.527395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad396-95d7-4903-850d-ec3c066204ed admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.532074 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.532691 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.532977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.533258 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.533921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.535856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.561868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1389/2753] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:14.565907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.579651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c90bb-03dc-4f8c-b3bd-aa9f852ce0de None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.636958 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.637587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.637885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.638162 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.638887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.640818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.674693 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1365/2754] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:14.674816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.678640 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf208e-ea15-420f-bdc5-63b1ebb814cc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.684026 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.684658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.684924 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.685200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.685898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.687512 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.701211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1390/2755] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:14.705074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.715605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0434037-6cd2-4a99-ae51-a614c4f32163 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.720185 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.720797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.721083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.721361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.722049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.723670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1498ba8-572e-4f46-885f-51d1bc5b1b06 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.724989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:14.738616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1366/2756] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:14.739745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.751731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfdc6b-9ead-48be-842f-67abbd39b6af admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.757071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.758359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.758693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.758947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] PATH_INFO: `/v3/projects/2e54ae9e63714cc5b7a92a16032bb598/users/df59284e1c1c4b6b92f64261058898e3/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.774155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e54ae9e63714cc5b7a92a16032bb598, user_id=df59284e1c1c4b6b92f64261058898e3, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.776859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:14.791169 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1391/2757] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:14 2022] PUT /identity/v3/projects/2e54ae9e63714cc5b7a92a16032bb598/users/df59284e1c1c4b6b92f64261058898e3/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:19:14.802804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.803135 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.803357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.837966 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] MFA Rules not processed for user `df59284e1c1c4b6b92f64261058898e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:14.839439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:14.907082 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1367/2758] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:14.911833 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:14.972562 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99fef-210c-4244-9b43-fc99a109d67c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:14.977178 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:14.977788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:14.978068 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:14.978343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:14.979057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:14.980983 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.008637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1392/2759] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:15.012872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.023907 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416c43-4d6a-42f9-9263-794457d165d6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.082041 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.082632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.082919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.083232 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.083866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.085786 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.112358 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1368/2760] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:15 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:19:15.113851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.125372 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea34205-396e-42ba-b841-9a9f470a8d98 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.132849 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.134012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.134463 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.134831 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.135596 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.137260 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.151635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1393/2761] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:15.156055 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.166614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dade-e409-435c-8418-ddfc69902a36 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.171368 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.172114 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.172542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.172884 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] PATH_INFO: `/v3/projects/7d3003ad178449bb87091d91c8bdb461/users/5f99c38b8937475aa479f184a03413d2/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.190417 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3003ad178449bb87091d91c8bdb461, user_id=5f99c38b8937475aa479f184a03413d2, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.193189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.208632 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1369/2762] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:15 2022] PUT /identity/v3/projects/7d3003ad178449bb87091d91c8bdb461/users/5f99c38b8937475aa479f184a03413d2/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:15.212731 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.222814 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828312d-cd9c-484c-8f0e-0970326f42b3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.261442 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:15.286663 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.287310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.287590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.287865 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.288574 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.290712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e19c8e-ea4e-4b36-b000-6ba4779b17c1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.300853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1394/2763] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:15.305726 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.316048 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495ea4-dcc6-419d-bd1a-e79bec9cc8b8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.320949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.321612 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.321894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.322178 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] PATH_INFO: `/v3/projects/7d3003ad178449bb87091d91c8bdb461/users/5f99c38b8937475aa479f184a03413d2/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.324608 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3003ad178449bb87091d91c8bdb461, user_id=5f99c38b8937475aa479f184a03413d2, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.327323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.338064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1370/2764] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:15 2022] PUT /identity/v3/projects/7d3003ad178449bb87091d91c8bdb461/users/5f99c38b8937475aa479f184a03413d2/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:15.348155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.348455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.348736 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.376846 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] MFA Rules not processed for user `5f99c38b8937475aa479f184a03413d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:15.378062 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:15.444930 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1395/2765] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:15.456293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:15.457988 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:15.501825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:15.538597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f583-f693-4484-a29c-fd3b4dfe3f06 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:15.542885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:15.543494 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:15.543773 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:15.544046 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:15.598042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:15.599503 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:15.609078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1371/2766] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:18.158702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:18.169431 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5241b-8d3b-4ed5-9421-f7a18443413a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:18.173106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:18.173729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:18.174020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:18.174303 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:18.237717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:18.239261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:18.249331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1396/2767] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:18.800932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:18.810347 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceaf1d-70c8-4d4b-bb51-c04484362e1b service cinder] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:18.814172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:18.814803 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:18.815085 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:18.815360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:18.824870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:18.826288 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c9092-ad3a-4fff-a590-00c45183b31b service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:18.836076 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1372/2768] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:21.870996 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:21.872711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:21.972233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:21.978750 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c358-135a-40f9-8172-c215f1e9efac service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:21.983383 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:21.984035 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:21.984322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:21.984604 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] PATH_INFO: `/v3/users/8099694506d7404c88fc173ea9b90ee7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:21.985795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8099694506d7404c88fc173ea9b90ee7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:21.987770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.036179 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8099694506d7404c88fc173ea9b90ee7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.036761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8099694506d7404c88fc173ea9b90ee7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.049991 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8099694506d7404c88fc173ea9b90ee7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.057651 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8099694506d7404c88fc173ea9b90ee7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.058385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8099694506d7404c88fc173ea9b90ee7'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.072152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1397/2769] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:21 2022] DELETE /identity/v3/users/8099694506d7404c88fc173ea9b90ee7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:22.076615 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.077180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.077290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.096902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:22.098190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.160929 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1373/2770] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:22.170869 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.172377 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.233582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e04b-9cd9-491e-a5dd-e0b113f090eb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.237288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.237913 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.238205 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.238542 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.248584 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.250037 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52ca5e-0cbb-4576-ba08-cb19cad6cb9d service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.260693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1398/2771] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:19:22.574808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.576322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.588826 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356df1d0-355d-4399-852c-b96ab0aec261 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.593651 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.594370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.594639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.594924 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] PATH_INFO: `/v3/projects/5b53a74f993e4cabafcd3256409f6cde` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.596103 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b53a74f993e4cabafcd3256409f6cde)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.598102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.654390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b53a74f993e4cabafcd3256409f6cde', 'request_id': 'req-998ea5f6-ba93-4c9b-856e-06c3ba457e82'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.658509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:22.662602 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b53a74f993e4cabafcd3256409f6cde', 'request_id': 'req-998ea5f6-ba93-4c9b-856e-06c3ba457e82'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.671059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b53a74f993e4cabafcd3256409f6cde', 'request_id': 'req-998ea5f6-ba93-4c9b-856e-06c3ba457e82'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.683941 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] The token cache is being invalidate because project 5b53a74f993e4cabafcd3256409f6cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:22.684240 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.684904 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.686474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1374/2772] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:22 2022] DELETE /identity/v3/projects/5b53a74f993e4cabafcd3256409f6cde => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:22.692066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cafb8-a396-4095-a9d5-eb7c01b21a23 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.692358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cafb8-a396-4095-a9d5-eb7c01b21a23 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.692641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cafb8-a396-4095-a9d5-eb7c01b21a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.712780 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-351cafb8-a396-4095-a9d5-eb7c01b21a23 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:22.713994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-351cafb8-a396-4095-a9d5-eb7c01b21a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.722061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.723498 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.775726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1399/2773] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:22.783454 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.783746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.784027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.795086 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ea5f6-ba93-4c9b-856e-06c3ba457e82 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.800421 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.801079 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.801370 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.801785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] PATH_INFO: `/v3/users/8b42a419839f4c6da54e928ed67af20a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.803540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b42a419839f4c6da54e928ed67af20a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.804361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:22.804996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.806131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.814823 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1400/2774] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:22.819180 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.828235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbabc36-6562-4363-ae68-b0a8239d5771 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.834141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.834800 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.835069 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.835339 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.836040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:19:22.836433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.838521 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.846318 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:22.852860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1401/2775] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:19:22.856485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b42a419839f4c6da54e928ed67af20a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.856925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.863999 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b42a419839f4c6da54e928ed67af20a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.866411 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085171f-5265-4668-b24f-15d3b97781c1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.871702 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.872306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.872587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.872870 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.873541 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.875480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.877733 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b42a419839f4c6da54e928ed67af20a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.885490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b42a419839f4c6da54e928ed67af20a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.886644 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-f5f7a9ee-165d-478d-87c5-03299fda2155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b42a419839f4c6da54e928ed67af20a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:22.893542 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1375/2776] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:22 2022] DELETE /identity/v3/users/8b42a419839f4c6da54e928ed67af20a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:19:22.898480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406366-e5ce-4dab-9346-716c85577980 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.899040 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406366-e5ce-4dab-9346-716c85577980 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.899323 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406366-e5ce-4dab-9346-716c85577980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.907355 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1402/2777] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:19:22.908376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.910151 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.918668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-51406366-e5ce-4dab-9346-716c85577980 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:22.919889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-51406366-e5ce-4dab-9346-716c85577980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.974623 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442a273-925f-47bb-9b1b-8ead251d50c1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:22.979860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:22.980440 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1376/2778] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:22.980728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:22.980728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:22.981085 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:22.981755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:22.983837 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:22.990415 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406366-e5ce-4dab-9346-716c85577980 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:22.991923 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-51406366-e5ce-4dab-9346-716c85577980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:22.997707 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:23.006401 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1403/2779] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:22 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:19:23.010455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.020527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0476f1-9748-44db-abc7-4833b723ea62 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.025818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.026485 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.026776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.027048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.027748 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.029344 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.039516 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1404/2780] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:19:23.044019 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.054347 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c43-caf5-4cff-bcaf-3c1e876068da admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.059954 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.060409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406366-e5ce-4dab-9346-716c85577980 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.060932 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.061218 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.061537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.062181 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.063861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.064360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.064980 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.065266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.065546 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.074795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1405/2781] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:19:23.078343 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.079087 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.079842 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9bcba-c7ff-4610-af1f-b86ba38620ae service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.089769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2abae8-707d-4395-a024-a6bfaea0885d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.093365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1377/2782] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:19:23.095271 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.096034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.096445 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.096745 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] PATH_INFO: `/v3/projects/2ce7ecd279e342cc85d1cb3df484b32f/users/2b31a4124a55495099df2b397b79e78c/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.118098 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce7ecd279e342cc85d1cb3df484b32f, user_id=2b31a4124a55495099df2b397b79e78c, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.119590 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.136343 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1406/2783] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:23 2022] PUT /identity/v3/projects/2ce7ecd279e342cc85d1cb3df484b32f/users/2b31a4124a55495099df2b397b79e78c/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:19:23.146600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.146899 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.147190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.178665 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] MFA Rules not processed for user `2b31a4124a55495099df2b397b79e78c`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:23.179886 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:23.247278 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1378/2784] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:23.260251 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.263057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:23.324126 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477def-c6b1-4c66-b7c2-805ab9ad7d88 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.327878 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fbf4cc412649fba94ad020f6221b17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.328503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.328788 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.329066 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.338288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.339761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.349142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1407/2785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:23.403727 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.405587 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:23.487296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63aae-cecd-4b1b-91bf-a51415c413a4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.492389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.493089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.493375 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.493660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] PATH_INFO: `/v3/projects/7a5c8d79513c4b628b8eb5895ab31abf` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.495065 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5c8d79513c4b628b8eb5895ab31abf)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.497172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.542378 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:23.553812 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5c8d79513c4b628b8eb5895ab31abf', 'request_id': 'req-d495cfee-c981-4e3f-8092-9963cddc244a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.563363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5c8d79513c4b628b8eb5895ab31abf', 'request_id': 'req-d495cfee-c981-4e3f-8092-9963cddc244a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.569859 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5c8d79513c4b628b8eb5895ab31abf', 'request_id': 'req-d495cfee-c981-4e3f-8092-9963cddc244a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.583062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] The token cache is being invalidate because project 7a5c8d79513c4b628b8eb5895ab31abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:23.583422 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.584100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.585629 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1379/2786] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:23 2022] DELETE /identity/v3/projects/7a5c8d79513c4b628b8eb5895ab31abf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:23.590211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:23.601564 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520f9f-80aa-49e6-9349-46f1e30083b7 service glance] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:23.624776 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:23.673242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:23.673909 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:23.674188 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:23.674518 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] PATH_INFO: `/v3/users/df59284e1c1c4b6b92f64261058898e3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:23.675785 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df59284e1c1c4b6b92f64261058898e3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:23.677835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:23.742142 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df59284e1c1c4b6b92f64261058898e3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.742852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df59284e1c1c4b6b92f64261058898e3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.760203 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df59284e1c1c4b6b92f64261058898e3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.771533 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df59284e1c1c4b6b92f64261058898e3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.772579 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df59284e1c1c4b6b92f64261058898e3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:23.804819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1408/2787] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:23 2022] DELETE /identity/v3/users/df59284e1c1c4b6b92f64261058898e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:24.223511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:24.226569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:24.249107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495cfee-c981-4e3f-8092-9963cddc244a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:24.324102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:24.324769 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:24.325062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:24.325346 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] PATH_INFO: `/v3/projects/2e54ae9e63714cc5b7a92a16032bb598` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:24.326567 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e54ae9e63714cc5b7a92a16032bb598)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:24.328547 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:24.384168 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e54ae9e63714cc5b7a92a16032bb598', 'request_id': 'req-08d66e22-7dee-4ce4-b4ba-506161d61bb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.394030 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e54ae9e63714cc5b7a92a16032bb598', 'request_id': 'req-08d66e22-7dee-4ce4-b4ba-506161d61bb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.402550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e54ae9e63714cc5b7a92a16032bb598', 'request_id': 'req-08d66e22-7dee-4ce4-b4ba-506161d61bb6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.416177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] The token cache is being invalidate because project 2e54ae9e63714cc5b7a92a16032bb598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:24.416478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.417316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.418998 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1380/2788] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:24 2022] DELETE /identity/v3/projects/2e54ae9e63714cc5b7a92a16032bb598 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:24.423194 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:24.424758 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:24.438842 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78b66-077f-49f7-94c9-8a1b639746f9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:24.513727 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:24.514392 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:24.514718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:24.515003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] PATH_INFO: `/v3/users/5f99c38b8937475aa479f184a03413d2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:24.516223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f99c38b8937475aa479f184a03413d2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:24.518130 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:24.567863 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:24.572641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f99c38b8937475aa479f184a03413d2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.573733 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f99c38b8937475aa479f184a03413d2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.592520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f99c38b8937475aa479f184a03413d2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.599480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f99c38b8937475aa479f184a03413d2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.600341 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ff6d95bb-395d-4643-b2c9-d63ef084cfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f99c38b8937475aa479f184a03413d2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:24.615141 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1409/2789] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:24 2022] DELETE /identity/v3/users/5f99c38b8937475aa479f184a03413d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:24.915772 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:24.917213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:24.934297 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66e22-7dee-4ce4-b4ba-506161d61bb6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:24.999399 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:25.007837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.009892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.009892 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.010585 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] PATH_INFO: `/v3/projects/7d3003ad178449bb87091d91c8bdb461` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.011971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3003ad178449bb87091d91c8bdb461)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.014485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.072478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3003ad178449bb87091d91c8bdb461', 'request_id': 'req-b51652f4-936c-4f46-916b-c8f550d3fbde'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:25.081563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3003ad178449bb87091d91c8bdb461', 'request_id': 'req-b51652f4-936c-4f46-916b-c8f550d3fbde'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:25.088322 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3003ad178449bb87091d91c8bdb461', 'request_id': 'req-b51652f4-936c-4f46-916b-c8f550d3fbde'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:25.103340 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] The token cache is being invalidate because project 7d3003ad178449bb87091d91c8bdb461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:25.103630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:25.104305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-b51652f4-936c-4f46-916b-c8f550d3fbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:25.105828 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1381/2790] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:24 2022] DELETE /identity/v3/projects/7d3003ad178449bb87091d91c8bdb461 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:25.110804 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.111845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.111845 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.131480 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:25.132711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:25.202375 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1410/2791] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:25.210321 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.210699 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.211075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.232830 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:25.234134 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:25.243894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1382/2792] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:25.249166 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.259832 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62083bf-5548-4ddc-985f-eab16d922176 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.265175 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.265852 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.266322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.266659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.267370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:19:25.267711 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.269591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.283184 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1411/2793] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:19:25.287545 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.297228 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1846bf-85b5-4a27-a101-682863219ebc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.302128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.302883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.303276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.303630 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.304420 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.307064 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.341519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1383/2794] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:25 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:19:25.345656 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.358877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c30b-e3ab-4e24-8d58-00056753a941 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.422815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.423795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.424508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.424508 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.425033 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.427027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.451717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1412/2795] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:25 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:25.455991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.467170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e64b-a9d8-410d-8a96-99131472aca6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.474949 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.475712 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.476009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.478975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.478975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.478975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.493286 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1384/2796] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:25.497789 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.511885 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1815-e8cf-4e8e-aa04-4927a66f63d0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.516618 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.517248 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.517534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.517815 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.518552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.520552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d97df0-3f65-4031-a870-d0c50876664b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.535861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1413/2797] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:19:25.537367 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.548261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71328da4-47c7-4f01-aea7-820019c8bb4c admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.556742 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.557438 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.557725 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.558007 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] PATH_INFO: `/v3/projects/20296a9e3969428f9d487f021f06e524/users/5dfc8cbb23024495934b76d07b281996/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.573521 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20296a9e3969428f9d487f021f06e524, user_id=5dfc8cbb23024495934b76d07b281996, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.576866 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.591857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1385/2798] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:25 2022] PUT /identity/v3/projects/20296a9e3969428f9d487f021f06e524/users/5dfc8cbb23024495934b76d07b281996/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:25.597020 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b897b-1f6f-47f5-a234-9628da570aa1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.597311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b897b-1f6f-47f5-a234-9628da570aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.597594 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b897b-1f6f-47f5-a234-9628da570aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.619633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bd3b897b-1f6f-47f5-a234-9628da570aa1 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:25.620861 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd3b897b-1f6f-47f5-a234-9628da570aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:25.670215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:25.724025 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1414/2799] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:25.735975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:25.737768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:25.802199 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d23c42-e77d-4dc1-82b8-0a581b0910f6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:25.807219 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:25.808042 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:25.808341 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:25.808623 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:25.818914 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:25.820381 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:25.833588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1386/2800] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:26.691191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906233-06ab-474d-850e-13286b2d7cc6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:26.691191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906233-06ab-474d-850e-13286b2d7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:26.691191 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906233-06ab-474d-850e-13286b2d7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:26.725583 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d9906233-06ab-474d-850e-13286b2d7cc6 None None] MFA Rules not processed for user `5dfc8cbb23024495934b76d07b281996`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:26.726818 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d9906233-06ab-474d-850e-13286b2d7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:26.798531 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1415/2801] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:26.812459 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:26.814111 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:26.847954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:26.885927 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917c89-bc69-4900-b5e5-fc8147ba3af6 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:26.890179 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:26.890844 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:26.891128 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:26.891404 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:26.900768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:26.902196 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1cc84-7e96-4e99-a8f9-3dbbc7b9040b service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:26.911175 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1387/2802] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:28.346493 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:28.347049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:28.347049 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:28.366500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] MFA Rules not processed for user `5dfc8cbb23024495934b76d07b281996`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:28.368223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:28.375114 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1416/2803] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:36.907207 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=15 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:38.361282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=50 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:45.105214 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc01a4-840e-48b4-989e-4d7414bccf55 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:45.105766 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc01a4-840e-48b4-989e-4d7414bccf55 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:45.105894 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc01a4-840e-48b4-989e-4d7414bccf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:45.124946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b6dc01a4-840e-48b4-989e-4d7414bccf55 None None] MFA Rules not processed for user `5dfc8cbb23024495934b76d07b281996`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:45.126143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b6dc01a4-840e-48b4-989e-4d7414bccf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:45.133049 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1388/2804] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:53.771361 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:53.773359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:53.787228 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6d98-a0f6-4c82-95e1-8d2ac086e281 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:53.792828 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:53.793558 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:53.793851 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:53.794162 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] PATH_INFO: `/v3/users/2b31a4124a55495099df2b397b79e78c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:53.795386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b31a4124a55495099df2b397b79e78c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:53.797353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:53.846071 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b31a4124a55495099df2b397b79e78c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:53.846761 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b31a4124a55495099df2b397b79e78c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:53.859159 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b31a4124a55495099df2b397b79e78c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:53.865938 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b31a4124a55495099df2b397b79e78c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:53.866639 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b31a4124a55495099df2b397b79e78c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:53.879121 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1417/2805] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:19:53 2022] DELETE /identity/v3/users/2b31a4124a55495099df2b397b79e78c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:53.883657 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:53.884148 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:53.884263 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:53.903660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:53.904845 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:53.964522 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1389/2806] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:53.974265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:53.975681 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:54.034353 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72ccd-a68e-49bf-900f-a6308a757df6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.038006 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.038652 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.038939 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.039220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.048108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.049522 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1835c-02f1-42ea-85b4-b4548a7926fd service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.058853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1418/2807] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:54.333944 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.335578 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:54.351158 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5b3c9-05c4-49df-9d72-f20842709482 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.356510 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.357159 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.357439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.357714 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] PATH_INFO: `/v3/projects/2ce7ecd279e342cc85d1cb3df484b32f` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.358913 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce7ecd279e342cc85d1cb3df484b32f)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.361649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.414353 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce7ecd279e342cc85d1cb3df484b32f', 'request_id': 'req-6dc37e56-834b-48ef-bf85-6f4a692da7fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:54.422691 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce7ecd279e342cc85d1cb3df484b32f', 'request_id': 'req-6dc37e56-834b-48ef-bf85-6f4a692da7fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:54.429505 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce7ecd279e342cc85d1cb3df484b32f', 'request_id': 'req-6dc37e56-834b-48ef-bf85-6f4a692da7fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:54.443037 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] The token cache is being invalidate because project 2ce7ecd279e342cc85d1cb3df484b32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:19:54.443339 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:54.444034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-6dc37e56-834b-48ef-bf85-6f4a692da7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:19:54.445683 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1390/2808] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:19:54 2022] DELETE /identity/v3/projects/2ce7ecd279e342cc85d1cb3df484b32f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:54.451065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.451360 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.451643 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.471112 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:54.472352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:54.534386 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1419/2809] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:19:54.542127 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.542425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.542741 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.563143 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:54.564364 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:54.573272 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1391/2810] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:54.577382 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.587209 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca31d5-a1fd-4071-be58-3af04fb8f736 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.591860 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.592472 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.592762 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.593034 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.593722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:19:54.594030 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.595679 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.607155 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1420/2811] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:19:54.611405 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.621474 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853fb8-eabc-4e8e-b9e0-01a453215fd0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.626164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.626822 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.627110 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.627391 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.628078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.629984 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.659553 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1392/2812] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:19:54 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:54.663757 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.668988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:54.675084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce0c-2c05-46a0-81be-333b2eadf95f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.734982 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.735641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.735926 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.736234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.736908 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.738856 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.761921 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1421/2813] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:19:54 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:19:54.766092 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.776774 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f942-b5b0-4d7f-8735-323fd3ceec0b admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.781952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.782408 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.782740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.783012 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.783818 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.785529 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.796445 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1393/2814] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:54.800626 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.811455 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f41e-7c67-4498-b1fb-04dbbbc69a4b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.816111 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.816728 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.817017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.817299 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.817990 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.819650 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf06ef-218f-4414-a33c-b31c0a082596 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.830316 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1422/2815] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:19:54.834396 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:54.844809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2aa61-735e-4a96-adb4-a196aa4c89ae admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:54.849903 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:54.850609 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.850919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.851200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] PATH_INFO: `/v3/projects/2584328cecd045829ee502063fcf9e21/users/8e1ae81db46c46cfa80ddcd32ed57237/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.866517 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2584328cecd045829ee502063fcf9e21, user_id=8e1ae81db46c46cfa80ddcd32ed57237, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:54.869757 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:54.882867 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1394/2816] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:19:54 2022] PUT /identity/v3/projects/2584328cecd045829ee502063fcf9e21/users/8e1ae81db46c46cfa80ddcd32ed57237/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:19:54.893036 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec48bd-2ae6-4a2e-912d-88d860152c94 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:54.893416 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec48bd-2ae6-4a2e-912d-88d860152c94 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:54.893801 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec48bd-2ae6-4a2e-912d-88d860152c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:54.926301 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8bec48bd-2ae6-4a2e-912d-88d860152c94 None None] MFA Rules not processed for user `8e1ae81db46c46cfa80ddcd32ed57237`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:54.927565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8bec48bd-2ae6-4a2e-912d-88d860152c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:54.994407 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1423/2817] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:19:55.005109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:19:55.006875 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:55.022861 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:55.066470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629286a-f0bf-471c-ac45-ca342b77afa8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:19:55.071304 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:19:55.071932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:55.072267 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:55.072639 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:55.082336 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:19:55.083761 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e6844-fbac-4b1c-acbc-808955fd9e58 service cinder] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:19:55.093492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1395/2818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:19:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:19:56.471314 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:19:56.471853 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:19:56.472238 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:19:56.500565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] MFA Rules not processed for user `8e1ae81db46c46cfa80ddcd32ed57237`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:19:56.501906 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:19:56.510621 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1424/2819] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:05.089233 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=20 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:06.494637 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:08.754140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569fa5-eea9-49cc-9a3f-0243c818029a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:08.754648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569fa5-eea9-49cc-9a3f-0243c818029a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:08.754760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569fa5-eea9-49cc-9a3f-0243c818029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:08.784337 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d5569fa5-eea9-49cc-9a3f-0243c818029a None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:08.785558 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d5569fa5-eea9-49cc-9a3f-0243c818029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:08.847490 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1396/2820] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:08.893642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:08.895568 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:08.964534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1fd3-14db-40d6-b402-7b8881ca3b7b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:08.969477 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:08.970131 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:08.970505 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:08.970795 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:08.979488 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:08.981081 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:08.989065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1425/2821] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:20:14.405619 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cadf70-a673-490c-89c7-3f4cd50bf957 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:14.406119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cadf70-a673-490c-89c7-3f4cd50bf957 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:14.406409 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cadf70-a673-490c-89c7-3f4cd50bf957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:14.427570 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d1cadf70-a673-490c-89c7-3f4cd50bf957 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:14.428962 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d1cadf70-a673-490c-89c7-3f4cd50bf957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:14.437289 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1397/2822] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:14.453263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:14.466349 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a99c4a-beee-46d9-bb43-c87d84532def service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:14.472075 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:14.472710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:14.473031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:14.475398 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:14.482904 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:14.484537 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:14.498113 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1426/2823] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:20:15.108360 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda58-f9b6-4a54-b4eb-ce1abb250569 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:15.108800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda58-f9b6-4a54-b4eb-ce1abb250569 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:15.109248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda58-f9b6-4a54-b4eb-ce1abb250569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:15.132559 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-babbda58-f9b6-4a54-b4eb-ce1abb250569 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:15.134050 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-babbda58-f9b6-4a54-b4eb-ce1abb250569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:15.142015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1398/2824] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:20:15.157415 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:15.170340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960832-65f6-4441-a8d3-c1854c5527b3 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:15.175874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:15.176503 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:15.176790 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:15.177070 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:15.186920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:15.188754 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:15.200444 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1427/2825] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:20:15.476301 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230222-4b88-4ab3-a428-965df2975350 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:15.476808 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230222-4b88-4ab3-a428-965df2975350 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:15.477097 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230222-4b88-4ab3-a428-965df2975350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:15.506266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8a230222-4b88-4ab3-a428-965df2975350 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:15.507690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8a230222-4b88-4ab3-a428-965df2975350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:15.518383 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1399/2826] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 3 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:15.535110 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:15.547892 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076391a4-ff85-4868-be6d-836c236c6106 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:15.553331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:15.554003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:15.554288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:15.554587 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:15.564622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:15.566791 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:15.577481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1428/2827] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:20:15.984950 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:15.985165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:15.985463 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:16.008189 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:16.009468 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:16.018466 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1400/2828] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:16.034239 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:16.046578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454f323-3a01-4b3c-bfff-5bf81b226406 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:16.052659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:16.053368 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:16.053743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:16.054227 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:16.063437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:16.065139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56b4cb-15e8-498d-b59e-93981e55b550 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:16.076296 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1429/2829] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:20:18.429243 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:18.515260 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd051-89ba-4fbf-bc7c-f7357725aac1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:18.520883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:18.521561 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:18.521847 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:18.522121 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] PATH_INFO: `/v3/users/8e1ae81db46c46cfa80ddcd32ed57237` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:18.523495 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1ae81db46c46cfa80ddcd32ed57237)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:18.525419 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:18.584716 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1ae81db46c46cfa80ddcd32ed57237'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:18.593393 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1ae81db46c46cfa80ddcd32ed57237'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:18.601667 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:18.611933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1ae81db46c46cfa80ddcd32ed57237'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:18.620872 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1ae81db46c46cfa80ddcd32ed57237'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:18.621675 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1ae81db46c46cfa80ddcd32ed57237'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:18.630740 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1401/2830] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:20:18 2022] DELETE /identity/v3/users/8e1ae81db46c46cfa80ddcd32ed57237 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:20:18.635226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:18.636138 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:18.636617 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:18.658534 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:18.660048 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:18.726193 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1430/2831] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:18.740952 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:18.742684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:18.811731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355430bc-ec4e-4734-91e5-658114bd103d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:18.816282 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:18.817234 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:18.817511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:18.817790 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:18.829483 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:18.830977 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae76f13-ea41-47ff-ad05-33411c8c8c1d service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:18.847668 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1402/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:20:19.094979 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.096999 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:19.110774 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589efba5-778e-44d8-b722-1139acb5f049 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.116499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.118003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.118500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.118786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] PATH_INFO: `/v3/projects/2584328cecd045829ee502063fcf9e21` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.121336 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2584328cecd045829ee502063fcf9e21)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.142311 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.188499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:19.203907 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2584328cecd045829ee502063fcf9e21', 'request_id': 'req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:19.211492 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2584328cecd045829ee502063fcf9e21', 'request_id': 'req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:19.218755 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2584328cecd045829ee502063fcf9e21', 'request_id': 'req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:19.237234 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] The token cache is being invalidate because project 2584328cecd045829ee502063fcf9e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:20:19.237622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:19.238332 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f90c6fd9-5082-4dc8-943d-07673f3aa6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:19.239974 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1431/2833] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:20:19 2022] DELETE /identity/v3/projects/2584328cecd045829ee502063fcf9e21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:20:19.245491 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.245791 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.246077 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.267307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:19.268540 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:19.335765 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1403/2834] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:19.343150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.343440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.343726 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.364199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:19.365331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:19.374079 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1432/2835] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:19.378703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.395797 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0285e1-d564-4dc8-aa0c-abe297af1891 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.404724 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.405443 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.405735 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.406033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.406795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:20:19.407109 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.408815 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.422752 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1404/2836] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:20:19.426767 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.440952 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd2b6c-9480-461d-8d64-9b718c3ca740 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.447388 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.448743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.449226 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.449636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.450358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.452548 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.489819 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1433/2837] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:20:19.494356 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.505488 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc557db1-69d3-4f6a-ac38-98b16dc9c45e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.580739 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.581379 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.581661 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.581937 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.582710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.584688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.618003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1405/2838] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:20:19 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:20:19.619133 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.633215 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14cc1-9367-4709-829e-969a726826a4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.639875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.640576 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.640802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.641282 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.642003 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.643690 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.655376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1434/2839] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:20:19.661868 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.668124 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:19.676821 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d130-2f57-4b00-815d-e20feb1c14b5 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.684270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.684920 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.685213 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.685501 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.686276 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.688034 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53eed9f-31aa-4ccc-8652-a301b292bb0a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.703361 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1406/2840] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:20:19.704715 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.715395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d84dd-105d-4829-a870-4357740897ce admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.720255 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.721000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.721358 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.721710 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] PATH_INFO: `/v3/projects/c22099d8e85e4430a1c4ad2bb60d61db/users/723938a1e3494a3cac89fdb466daa23f/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.743630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22099d8e85e4430a1c4ad2bb60d61db, user_id=723938a1e3494a3cac89fdb466daa23f, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.750040 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.791688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1435/2841] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:20:19 2022] PUT /identity/v3/projects/c22099d8e85e4430a1c4ad2bb60d61db/users/723938a1e3494a3cac89fdb466daa23f/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:20:19.796785 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f75e40-907d-4700-aa2d-41c89169710f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.797059 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f75e40-907d-4700-aa2d-41c89169710f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.797345 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f75e40-907d-4700-aa2d-41c89169710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.817390 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-33f75e40-907d-4700-aa2d-41c89169710f None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:19.818621 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-33f75e40-907d-4700-aa2d-41c89169710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:19.887993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1407/2842] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:19.898474 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:19.900951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:19.969183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076130-0c5e-4bab-9681-23cf723d0ca4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:19.973835 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:19.974631 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:19.975021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:19.975402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:19.986662 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:19.988264 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:19.998958 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1436/2843] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:20:21.144837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6efb-e4dd-4435-85a0-7f189e9f9894 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:21.145736 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6efb-e4dd-4435-85a0-7f189e9f9894 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:21.146068 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6efb-e4dd-4435-85a0-7f189e9f9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:21.189493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ff7d6efb-e4dd-4435-85a0-7f189e9f9894 None None] MFA Rules not processed for user `723938a1e3494a3cac89fdb466daa23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:21.190795 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ff7d6efb-e4dd-4435-85a0-7f189e9f9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:21.268947 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1408/2844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:21.282324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:21.284708 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:21.381376 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c2d5-691c-4d9a-862a-a561d121bb2a service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:21.388483 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acea16a4c33b4d5e96889f5600c35666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:21.389948 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:21.390240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:21.390552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:21.401253 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:21.403400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b988-80ac-4b01-bcf7-130ecb20b80a service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:21.418659 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1437/2845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:20:22.864248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:22.864933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:22.864933 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:22.885100 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] MFA Rules not processed for user `723938a1e3494a3cac89fdb466daa23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:22.886377 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:22.898392 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1409/2846] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:24.211223 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:24.211712 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:24.211840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:24.219340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:24.234352 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] MFA Rules not processed for user `87701f1211364da59d0b76bbc737d102`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:20:24.235578 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:24.292923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1438/2847] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 3 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:20:24.305153 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:24.306588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:24.383296 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726558-6eab-4c74-bda1-f8c76824ab39 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:24.389307 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55ffdc3893f45e0881043a7b10857b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:24.389880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:24.390172 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:24.390614 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:24.400133 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:24.402287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:24.411269 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1410/2848] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 3 12:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:20:26.403527 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:26.405011 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:20:26.419117 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511063-4bd2-4996-92e5-636af45780b1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:26.423716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:26.424359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:26.424645 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:26.424923 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] PATH_INFO: `/v3/users/5dfc8cbb23024495934b76d07b281996` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:26.426108 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfc8cbb23024495934b76d07b281996)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:26.428123 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:26.474167 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfc8cbb23024495934b76d07b281996'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.474848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfc8cbb23024495934b76d07b281996'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.492236 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfc8cbb23024495934b76d07b281996'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.499082 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfc8cbb23024495934b76d07b281996'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.499936 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfc8cbb23024495934b76d07b281996'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.513199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1439/2849] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:20:26 2022] DELETE /identity/v3/users/5dfc8cbb23024495934b76d07b281996 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:20:26.688768 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:20:26.695120 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:26.700554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b74d0-74b1-408c-8346-eceaed22f1b0 service swift] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:20:26.757809 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:20:26.758485 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:20:26.758783 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:20:26.759066 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] PATH_INFO: `/v3/projects/20296a9e3969428f9d487f021f06e524` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:20:26.760837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=20296a9e3969428f9d487f021f06e524)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:20:26.762943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:20:26.809248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20296a9e3969428f9d487f021f06e524', 'request_id': 'req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.818089 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20296a9e3969428f9d487f021f06e524', 'request_id': 'req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.826028 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20296a9e3969428f9d487f021f06e524', 'request_id': 'req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.837702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] The token cache is being invalidate because project 20296a9e3969428f9d487f021f06e524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:20:26.838139 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.839035 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:20:26.840959 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1411/2850] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:20:26 2022] DELETE /identity/v3/projects/20296a9e3969428f9d487f021f06e524 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:20:36.509157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:36.834140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.978705 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:02.980436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:03.041565 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28391b3-72d2-4d7e-b64e-942192f166f7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:03.091305 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:03.091934 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:03.092221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:03.092816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:03.094544 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:03.185345 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:03.187337 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:03.211092 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1440/2851] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:21:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:21:04.545078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:04.547200 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:04.559436 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9317-5a99-4fdb-b68f-ca5d48b4c1cf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:04.563069 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:04.563713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:04.563996 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:04.564270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:04.565989 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:04.579620 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:04.581078 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6546a-1c9a-4404-966b-f97ede67bd6c service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:04.592970 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1412/2852] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:21:13.207787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=83 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:14.587215 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=6 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:19.099476 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:19.110294 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e686e1-8acf-4516-92c6-8a1297b2d315 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:19.113931 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:19.114573 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:19.114859 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:19.115137 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:19.116875 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:19.178803 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:19.180235 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:19.190433 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1441/2853] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:21:23.103101 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:23.103649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:23.103649 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:23.125023 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] MFA Rules not processed for user `723938a1e3494a3cac89fdb466daa23f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:21:23.126244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:23.188509 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1413/2854] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:21:26.119139 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:26.121437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:26.140031 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ec24-1e0d-4bf4-8e26-ae75a76c4603 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:26.146491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:26.147532 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:26.148004 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:26.148481 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] PATH_INFO: `/v3/users/5cf524f6288040219c0492d3a794e830` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:26.149768 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf524f6288040219c0492d3a794e830)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:26.151760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:26.211440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf524f6288040219c0492d3a794e830'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.211440 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf524f6288040219c0492d3a794e830'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.226374 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf524f6288040219c0492d3a794e830'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.233250 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf524f6288040219c0492d3a794e830'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.233977 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf524f6288040219c0492d3a794e830'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.251206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1442/2855] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:21:26 2022] DELETE /identity/v3/users/5cf524f6288040219c0492d3a794e830 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:21:26.446552 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:26.466349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921cbd-5d18-4400-98a6-c75c6aaa3db6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:26.530750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:26.531403 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:26.531688 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:26.531968 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] PATH_INFO: `/v3/projects/1a4c09dba5b24ef5b37b730b259d3790` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:26.533147 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4c09dba5b24ef5b37b730b259d3790)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:26.535280 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:26.591447 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4c09dba5b24ef5b37b730b259d3790', 'request_id': 'req-5abaa70c-fb30-495d-8a68-701623043d7a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.600583 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4c09dba5b24ef5b37b730b259d3790', 'request_id': 'req-5abaa70c-fb30-495d-8a68-701623043d7a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.607014 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4c09dba5b24ef5b37b730b259d3790', 'request_id': 'req-5abaa70c-fb30-495d-8a68-701623043d7a'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.620616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] The token cache is being invalidate because project 1a4c09dba5b24ef5b37b730b259d3790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:21:26.620616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.621365 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.623136 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1414/2856] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:21:26 2022] DELETE /identity/v3/projects/1a4c09dba5b24ef5b37b730b259d3790 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:21:26.627220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:26.628636 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:26.642520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b416c8-3ef2-49f1-8b6c-ad434586f26e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:26.707945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:26.708642 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:26.708968 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:26.709402 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] PATH_INFO: `/v3/users/526a63663dcb419fb7ba0052d2baef9f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:26.710646 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=526a63663dcb419fb7ba0052d2baef9f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:26.712675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:26.719104 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:26.766987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526a63663dcb419fb7ba0052d2baef9f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.767667 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526a63663dcb419fb7ba0052d2baef9f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.786023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526a63663dcb419fb7ba0052d2baef9f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.794933 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526a63663dcb419fb7ba0052d2baef9f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.802658 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526a63663dcb419fb7ba0052d2baef9f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:26.820340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1443/2857] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:21:26 2022] DELETE /identity/v3/users/526a63663dcb419fb7ba0052d2baef9f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:21:27.007424 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:27.009119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:27.028885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa70c-fb30-495d-8a68-701623043d7a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:27.073569 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:27.109624 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:27.110261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:27.110588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:27.110876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] PATH_INFO: `/v3/projects/cde7c862ecb3414ba4147e010cf00ef7` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:27.112061 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde7c862ecb3414ba4147e010cf00ef7)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:27.114029 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:27.164571 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde7c862ecb3414ba4147e010cf00ef7', 'request_id': 'req-8f5abb96-5602-4423-9cc9-36e3938fade6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:27.173033 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde7c862ecb3414ba4147e010cf00ef7', 'request_id': 'req-8f5abb96-5602-4423-9cc9-36e3938fade6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:27.179125 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde7c862ecb3414ba4147e010cf00ef7', 'request_id': 'req-8f5abb96-5602-4423-9cc9-36e3938fade6'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:27.190555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] The token cache is being invalidate because project cde7c862ecb3414ba4147e010cf00ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:21:27.190851 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:27.191513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:21:27.193075 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1415/2858] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:21:27 2022] DELETE /identity/v3/projects/cde7c862ecb3414ba4147e010cf00ef7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:21:36.814787 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:37.187534 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:52.491214 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:21:52.492988 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:52.571994 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95383-0690-4d2e-bfb7-06b6d5c83e7e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:21:52.635513 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:21:52.636146 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:21:52.636438 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:21:52.636718 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:21:52.638566 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:21:52.651457 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:21:52.652981 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:21:52.665201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1444/2859] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:02.659423 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=62 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:15.693203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:15.694778 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:15.769604 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5abb96-5602-4423-9cc9-36e3938fade6 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:15.775221 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:15.775855 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:15.776533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:15.776533 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:15.779597 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:15.795006 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:15.798300 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:15.798743 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:15.800945 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:15.813122 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1416/2860] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:15.870426 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213c06-69e7-4178-b7fd-f34b2e504e19 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:15.874963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:15.875622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:15.875914 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:15.876195 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] PATH_INFO: `/v3/users/723938a1e3494a3cac89fdb466daa23f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:15.877370 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=723938a1e3494a3cac89fdb466daa23f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:15.879379 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:15.931310 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723938a1e3494a3cac89fdb466daa23f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:15.932027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723938a1e3494a3cac89fdb466daa23f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:15.945836 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723938a1e3494a3cac89fdb466daa23f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:15.952857 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723938a1e3494a3cac89fdb466daa23f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:15.953602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9c1118d0-06f7-42da-ac3e-0a32dfa3d31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723938a1e3494a3cac89fdb466daa23f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:15.968274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1445/2861] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:22:15 2022] DELETE /identity/v3/users/723938a1e3494a3cac89fdb466daa23f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:22:16.161190 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.182831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad89b-d2d1-49d0-88af-7132eca77780 service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.252461 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.253690 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.254009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.254293 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] PATH_INFO: `/v3/projects/c22099d8e85e4430a1c4ad2bb60d61db` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.255564 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22099d8e85e4430a1c4ad2bb60d61db)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.257493 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.306413 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22099d8e85e4430a1c4ad2bb60d61db', 'request_id': 'req-2009c68c-2155-40a2-9fd5-d83d37715e15'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:16.314008 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22099d8e85e4430a1c4ad2bb60d61db', 'request_id': 'req-2009c68c-2155-40a2-9fd5-d83d37715e15'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:16.319940 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22099d8e85e4430a1c4ad2bb60d61db', 'request_id': 'req-2009c68c-2155-40a2-9fd5-d83d37715e15'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:16.331335 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] The token cache is being invalidate because project c22099d8e85e4430a1c4ad2bb60d61db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:22:16.331627 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:16.332291 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-2009c68c-2155-40a2-9fd5-d83d37715e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:22:16.333919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1417/2862] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:22:16 2022] DELETE /identity/v3/projects/c22099d8e85e4430a1c4ad2bb60d61db => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:22:16.339052 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.339340 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.339625 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.360552 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:16.361770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:16.432874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1446/2863] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:16.441943 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.442235 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.442638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.464273 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:16.465496 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:16.483722 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1418/2864] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:16.489150 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.502331 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8950233-1a99-49bf-92a1-c1456ad6f3f0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.507242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.507874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.508161 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.508434 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.509145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:22:16.509452 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.511129 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.524261 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1447/2865] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 3 12:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:22:16.528805 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.539031 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee10026-02dd-445b-80b1-7b8ebf0cb6cd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.543901 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.544536 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.544819 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.545094 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.545775 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.547917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.560905 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:16.590142 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1419/2866] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:22:16.594729 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.605673 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b91229-13a6-4845-98bb-9dc3bcec0e2b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.609520 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:16.668348 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.668984 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.669265 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.669570 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.670263 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.672268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.695000 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1448/2867] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:22:16 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:22:16.699163 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.710270 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119344-5336-4721-9457-4723b60f6745 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.715054 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.715696 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.715983 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.716266 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.717003 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.718654 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.729902 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1420/2868] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:22:16.734021 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.748864 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbe354-73ba-4d2d-8c87-84ced6759d09 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.754007 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.754674 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.754963 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.755240 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.755971 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.757572 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a695135-577c-4a82-86b1-14bc5f76a294 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.770491 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1449/2869] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:22:16.775053 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.785800 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653cbad-fa4d-4074-b175-43faeb4974bf admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.790590 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.791265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.791554 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.791841 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] PATH_INFO: `/v3/projects/b1199da325f44f4a86d9c7f0e3240e39/users/7bdcd9a30fe4463399960e4a4cc151fd/roles/271aea4edf604c2b829a1a2a8b83289e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.807366 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1199da325f44f4a86d9c7f0e3240e39, user_id=7bdcd9a30fe4463399960e4a4cc151fd, role_id=271aea4edf604c2b829a1a2a8b83289e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:16.810309 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:16.825062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1421/2870] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:22:16 2022] PUT /identity/v3/projects/b1199da325f44f4a86d9c7f0e3240e39/users/7bdcd9a30fe4463399960e4a4cc151fd/roles/271aea4edf604c2b829a1a2a8b83289e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:22:16.831046 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1681a-9f8c-4618-810f-d4966fd5f7dd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.832083 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1681a-9f8c-4618-810f-d4966fd5f7dd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.832288 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1681a-9f8c-4618-810f-d4966fd5f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:16.852084 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0fc1681a-9f8c-4618-810f-d4966fd5f7dd None None] MFA Rules not processed for user `0ebcadb74d2c4d319371eb661691d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:16.853308 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0fc1681a-9f8c-4618-810f-d4966fd5f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:16.913145 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1450/2871] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:16.923044 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:16.925287 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:16.989425 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea46cb-d8ac-4397-8be3-45b8f6cff998 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:16.993140 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:16.993781 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:16.994070 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:16.994352 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:17.005009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:17.006492 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:17.016857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1422/2872] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:21.346746 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.347393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.347393 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.377436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] MFA Rules not processed for user `7bdcd9a30fe4463399960e4a4cc151fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:21.379206 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:21.458816 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1451/2873] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:21.463555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.475000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf807c1-53fb-433b-bcfc-a13e38c877c3 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.480439 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.481265 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.481588 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.482032 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.482971 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.484513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.515519 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1423/2874] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 3 12:22:21 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:22:21.519675 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.531717 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa04194-1ce9-42cc-a5bc-a5df61e14111 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.544709 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:21.596506 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.597687 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.597964 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.598242 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.599024 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.600970 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.623585 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1452/2875] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 3 12:22:21 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:22:21.627928 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.638993 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda441da-c2eb-4816-aca2-752fe6b7510d admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.643964 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.644598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.644887 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.645170 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.646141 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.647871 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.660650 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1424/2876] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:22:21.664902 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.675992 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2aca5-38d6-4829-b897-5c0c2ebf04db admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.680665 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.681961 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.682254 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.682575 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] PATH_INFO: `/v3/projects/a2e1052d35d449139648267678d243dc/users/e35ca9324fce47e290ebb6a294e3f67b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.698806 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e1052d35d449139648267678d243dc, user_id=e35ca9324fce47e290ebb6a294e3f67b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.701459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.715591 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1453/2877] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:22:21 2022] PUT /identity/v3/projects/a2e1052d35d449139648267678d243dc/users/e35ca9324fce47e290ebb6a294e3f67b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:22:21.719703 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.734009 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac2400-5b7b-424e-bef2-a2c393de25a8 admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.822946 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.823593 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.823885 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.824165 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.824876 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.826574 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658f29-ee5e-4a98-9906-4e94929dc480 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.838211 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1425/2878] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 3 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:22:21.842854 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:21.854866 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99084-a83b-428f-80e2-ed74492db340 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:21.860499 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:21.861201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:21.861487 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:21.861773 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] PATH_INFO: `/v3/projects/a2e1052d35d449139648267678d243dc/users/e35ca9324fce47e290ebb6a294e3f67b/roles/b8b7263c1aac4d76b5376b2c9f7962d8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:21.864524 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e1052d35d449139648267678d243dc, user_id=e35ca9324fce47e290ebb6a294e3f67b, role_id=b8b7263c1aac4d76b5376b2c9f7962d8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:21.867211 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:21.896173 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1454/2879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 3 12:22:21 2022] PUT /identity/v3/projects/a2e1052d35d449139648267678d243dc/users/e35ca9324fce47e290ebb6a294e3f67b/roles/b8b7263c1aac4d76b5376b2c9f7962d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:22:26.490863 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118719-ade9-4f44-9640-10f4c80edb45 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:26.491746 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118719-ade9-4f44-9640-10f4c80edb45 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:26.492261 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118719-ade9-4f44-9640-10f4c80edb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:26.521389 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:26.526000 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-43118719-ade9-4f44-9640-10f4c80edb45 None None] MFA Rules not processed for user `e35ca9324fce47e290ebb6a294e3f67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:26.528181 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-43118719-ade9-4f44-9640-10f4c80edb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:26.609102 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1426/2880] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:26.625387 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:26.627241 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:26.705449 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba3af-f721-407a-8e7e-715b4d6932f2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:26.711588 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:26.712221 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:26.712500 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:26.712781 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:26.773324 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:26.774975 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:26.784528 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1455/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:27.776932 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:27.780880 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:27.781173 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:27.802316 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] MFA Rules not processed for user `7bdcd9a30fe4463399960e4a4cc151fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:22:27.803634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:27.811074 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1427/2882] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 3 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:22:36.780064 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:37.799144 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=31 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:42.355536 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:42.410369 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ed4-8d1d-4337-a6ed-3150f07376f4 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:42.414716 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:42.415334 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:42.415620 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:42.415899 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:42.417648 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:42.427043 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:42.428479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:42.436371 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1456/2883] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:43.884616 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:43.886022 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:43.958460 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9cc51-23bd-4034-ac35-2abedd9786df None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:43.963939 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:43.964577 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:43.964870 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:43.965155 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:43.966975 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:43.979640 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:43.981248 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:43.994326 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1428/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:48.682274 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:22:48.683868 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:48.695740 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a20b0-9d2e-444e-bd45-6fc20c1d818c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:22:48.699848 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:22:48.700479 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:22:48.700769 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:22:48.701054 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:22:48.702980 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:22:48.713920 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:22:48.715843 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:22:48.725017 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1457/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:22:53.987180 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=32 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:58.720840 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=32 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:23:01.234731 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:23:01.252151 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207498-c4e3-4eb2-a5fe-4b5428f9a03c service placement] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:23:01.258973 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:23:01.259283 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:23:01.259563 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:23:01.259857 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:23:01.261648 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:23:01.276244 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:23:01.278991 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:23:01.291083 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1429/2886] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:23:03.823283 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:23:03.832744 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a3de-1e9b-408f-9ef1-0db0faf5daad service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:23:03.837495 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:23:03.838116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:23:03.838633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:23:03.838779 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:23:03.849116 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:23:03.850630 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:23:03.861245 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1458/2887] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:23:05.443825 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:23:05.455349 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14036-1442-44f5-b74b-99e462d58084 service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:23:05.461481 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1231588fdfd54ace81dc7b2f35ec6f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:23:05.462108 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:23:05.462402 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:23:05.462710 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:23:05.464497 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:23:05.479799 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:23:05.481730 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:23:05.493883 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1430/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:23:13.856732 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:23:15.488750 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=12 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:24:06.624602 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:24:06.626106 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:24:06.641152 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac836-2429-43b0-8114-0f724f01b6fd service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:24:06.646127 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:24:06.647012 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:24:06.647300 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:24:06.647582 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:24:06.649266 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:24:06.660635 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:24:06.662201 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:24:06.672395 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1459/2889] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:24:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:24:16.668217 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:25:14.136310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:25:14.145555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1fd57-476b-458b-a7f1-5295df2941a4 service nova] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:25:14.149363 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:25:14.149969 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:25:14.150249 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:25:14.150557 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:25:14.152303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:25:14.164660 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:25:14.166107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:25:14.175192 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1431/2890] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:25:14.288027 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:25:14.297365 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26bcf5-17f4-493a-bc52-6305cb132bcd service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:25:14.301706 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:25:14.302322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:25:14.302641 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:25:14.302922 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:25:14.305023 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:25:14.315277 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:25:14.316670 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:25:14.325065 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1460/2891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:25:14.416743 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:25:14.425713 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826f1c-6877-4321-b51c-54210d2f7164 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:25:14.429478 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:25:14.430164 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:25:14.430555 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:25:14.430846 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:25:14.432626 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:25:14.446015 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:25:14.447480 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:25:14.458804 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1432/2892] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:25:24.321350 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:25:24.453513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=12 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:37.450359 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:37.460633 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cb40e-1db6-4121-9c9a-b4d4659972ff service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:37.465437 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:37.465622 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:37.465877 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:37.466157 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:37.467987 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:26:37.484976 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:37.486436 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:37.499220 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1461/2893] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:26:38.684290 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:38.693062 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d364-e61a-4bb4-be35-afa7fe3f86fb service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:38.697303 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a54a66e5b7c04048a1f881739e6b4ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:38.697917 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:38.698203 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:38.698511 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:38.700245 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:26:38.713747 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:38.715305 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:38.726702 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1433/2894] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:26:44.312097 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:44.324230 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fe147-f132-43fa-87b9-afc4bc0abc75 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:44.329322 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:44.329947 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:44.330233 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:44.330844 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:44.332624 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:26:44.345143 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:44.346760 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:44.360722 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1462/2895] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:26:47.539760 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:47.607764 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea4cf-dece-4b69-80a1-878f33ef1d88 service neutron] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:47.612257 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:47.612900 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:47.613191 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:47.613470 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] PATH_INFO: `/v3/users/7bdcd9a30fe4463399960e4a4cc151fd` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:47.614671 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdcd9a30fe4463399960e4a4cc151fd)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:47.616601 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:47.662634 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdcd9a30fe4463399960e4a4cc151fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:47.669995 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdcd9a30fe4463399960e4a4cc151fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:47.681864 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdcd9a30fe4463399960e4a4cc151fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:47.689310 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdcd9a30fe4463399960e4a4cc151fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:47.689954 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdcd9a30fe4463399960e4a4cc151fd'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:47.695925 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1434/2896] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:26:47 2022] DELETE /identity/v3/users/7bdcd9a30fe4463399960e4a4cc151fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:26:47.876951 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:47.889700 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe417786-fd0f-408d-86cb-477d0d4387b8 service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:47.960874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:47.962080 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:47.962385 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:47.962688 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] PATH_INFO: `/v3/projects/b1199da325f44f4a86d9c7f0e3240e39` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:47.963874 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1199da325f44f4a86d9c7f0e3240e39)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:47.965778 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:48.017414 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1199da325f44f4a86d9c7f0e3240e39', 'request_id': 'req-b6577524-7123-4e82-b997-4328418b5f54'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.023182 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1199da325f44f4a86d9c7f0e3240e39', 'request_id': 'req-b6577524-7123-4e82-b997-4328418b5f54'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.030199 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1199da325f44f4a86d9c7f0e3240e39', 'request_id': 'req-b6577524-7123-4e82-b997-4328418b5f54'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.042770 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] The token cache is being invalidate because project b1199da325f44f4a86d9c7f0e3240e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:26:48.043057 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.043693 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.045200 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1463/2897] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:26:47 2022] DELETE /identity/v3/projects/b1199da325f44f4a86d9c7f0e3240e39 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:26:48.049182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:48.050638 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:26:48.063605 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51759c83-208f-42f7-a178-b7622870cf9e admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:48.120889 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:48.121472 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:48.121756 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:48.122036 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] PATH_INFO: `/v3/users/e35ca9324fce47e290ebb6a294e3f67b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:48.123255 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ca9324fce47e290ebb6a294e3f67b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:48.125182 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:48.130600 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:48.172177 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ca9324fce47e290ebb6a294e3f67b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.179107 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ca9324fce47e290ebb6a294e3f67b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.190831 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ca9324fce47e290ebb6a294e3f67b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.199919 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ca9324fce47e290ebb6a294e3f67b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.200598 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.notifications [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ca9324fce47e290ebb6a294e3f67b'} {{(pid=80348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.206684 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1435/2898] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 3 12:26:48 2022] DELETE /identity/v3/users/e35ca9324fce47e290ebb6a294e3f67b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:26:48.386475 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:26:48.388400 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:26:48.403459 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577524-7123-4e82-b997-4328418b5f54 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:26:48.462306 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebcadb74d2c4d319371eb661691d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9288278a154c5e9a414320fa6388fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:26:48.462986 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:26:48.463268 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:26:48.463543 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] PATH_INFO: `/v3/projects/a2e1052d35d449139648267678d243dc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:26:48.464701 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e1052d35d449139648267678d243dc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:26:48.466612 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:26:48.472713 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:48.519786 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e1052d35d449139648267678d243dc', 'request_id': 'req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.525412 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e1052d35d449139648267678d243dc', 'request_id': 'req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.531462 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e1052d35d449139648267678d243dc', 'request_id': 'req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.543898 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] The token cache is being invalidate because project a2e1052d35d449139648267678d243dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:26:48.544183 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.544802 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-66c4f259-6545-4c51-ac6c-68d8c2de1ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:26:48.546307 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1464/2899] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 3 12:26:48 2022] DELETE /identity/v3/projects/a2e1052d35d449139648267678d243dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:26:58.203095 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:58.540925 dv-cinder-836027-3-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:29:14.562043 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:29:14.563513 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:29:14.710837 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f80f0c-accc-4cfc-97f8-3d07e615529a admin admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:29:14.768119 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3848fce2cc0541499c45dee60acec543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c965b4a154874b4082f263ae870a9bc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:29:14.768777 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:29:14.769071 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:29:14.769357 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:29:14.771129 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:29:14.782550 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:29:14.784670 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6f465-8c9b-4df4-be3c-47e40a3ca591 service placement] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:29:14.794631 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1436/2900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 3 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:29:24.790382 dv-cinder-836027-3-iscsi devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=89 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}